-- Logs begin at Mon 2022-07-25 17:56:11 UTC, end at Mon 2022-07-25 19:23:55 UTC. -- Jul 25 18:55:31.249573 dv-osbrick-850937-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 18:55:31.256873 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 18:55:31.259122 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 18:55:31 2022] *** Jul 25 18:55:31.259122 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 18:55:31.259122 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 18:55:31.259122 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: nodename: dv-osbrick-850937-1-ceph Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: machine: x86_64 Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: clock source: unix Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: pcre jit disabled Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: detected number of CPU cores: 4 Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: current working directory: / Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: detected binary path: /usr/bin/uwsgi-core Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: your processes number limit is 47680 Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: your memory page size is 4096 bytes Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: detected max file descriptor number: 2048 Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: lock engine: pthread robust mutexes Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: thunder lock: enabled Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 18:55:31.262172 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 18:55:31.305664 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: Python main interpreter initialized at 0x5586ecf0f9c0 Jul 25 18:55:31.305664 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: python threads support enabled Jul 25 18:55:31.305664 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: your server socket listen backlog is limited to 100 connections Jul 25 18:55:31.305664 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: your mercy for graceful operations on workers is 90 seconds Jul 25 18:55:31.306039 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 18:55:31.306117 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: *** Operational MODE: preforking *** Jul 25 18:55:31.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: *** uWSGI is running in multiple interpreter mode *** Jul 25 18:55:31.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: spawned uWSGI master process (pid: 87398) Jul 25 18:55:31.306543 dv-osbrick-850937-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 25 18:55:31.307476 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: spawned uWSGI worker 1 (pid: 87412, cores: 1) Jul 25 18:55:31.307572 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: spawned uWSGI worker 2 (pid: 87413, cores: 1) Jul 25 18:55:31.307718 dv-osbrick-850937-1-ceph devstack@keystone.service[87398]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 18:55:37.063634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 18:55:37.063634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: from cryptography.utils import int_from_bytes Jul 25 18:55:37.064448 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 18:55:37.064448 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: from cryptography.utils import int_from_bytes Jul 25 18:55:37.065174 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 18:55:37.065174 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: from cryptography.utils import int_from_bytes Jul 25 18:55:37.065768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 18:55:37.065768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: from cryptography.utils import int_from_bytes Jul 25 18:55:37.115416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 18:55:37.115618 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 18:55:37.115705 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 18:55:37.115804 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] command line args: [] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 18:55:37.115887 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 18:55:37.116014 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] command line args: [] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 18:55:37.116099 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 18:55:37.116238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ================================================================================ {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 18:55:37.116323 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 18:55:37.116455 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ================================================================================ {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 18:55:37.116540 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] admin_token = **** {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.116709 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] admin_token = **** {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.116787 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] config_dir = [] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.116911 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.116995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] config_dir = [] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.117094 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] config_source = [] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.117181 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.117258 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] debug = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.117333 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] config_source = [] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.117457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] debug = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.117538 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.118841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.118992 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.119079 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.119243 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.119330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.119402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.119526 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.119602 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.119723 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.119807 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] list_limit = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.119890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] list_limit = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.120011 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] log_config_append = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.120091 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] log_config_append = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.120167 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.120281 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.120355 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] log_dir = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.120481 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] log_dir = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.120591 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] log_file = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.120727 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] log_file = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.120803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.120917 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.121005 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.121141 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.121226 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.121343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.121418 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.121535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.121535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.121729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.121816 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.121894 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122227 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122227 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122495 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122610 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122816 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122898 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.122968 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123115 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123223 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123304 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123304 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123433 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.98/identity {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] publish_errors = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.98/identity {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.123893 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124015 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] publish_errors = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124166 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124240 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124354 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124428 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124509 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124597 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124668 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124790 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] standard_threads = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.124985 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] standard_threads = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125173 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125351 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125434 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125514 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] use_journal = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125695 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] use_json = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125772 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] use_journal = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125842 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] use_stderr = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.125954 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] use_json = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.126039 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] use_syslog = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.126132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] use_stderr = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.126214 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.126310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] use_syslog = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.126451 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.126535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:55:37.126691 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.126774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.126951 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.127056 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.127213 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.127333 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.127464 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.127568 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.127780 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.127894 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.128024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.128149 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.128264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.128385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.128499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.128620 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.128735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.128859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.128975 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.129088 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.129201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.129320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.129434 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.129556 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.129671 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.129798 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.129919 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.130043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.130165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.130356 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.130479 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.130600 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.130714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.130827 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.130941 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.131063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.131224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.131341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.131455 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.131569 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.131683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.131810 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.131928 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.132042 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.132156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.132269 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.132383 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.132506 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.132628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.132743 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.132856 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.132977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.133092 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.133218 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.133334 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.133447 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.133817 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.133938 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.134054 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.134176 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.134292 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.134406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.134519 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.134638 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.134763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.134885 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.134999 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.135114 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.135254 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.135384 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.135509 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.135631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.135746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.135860 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.135973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.136598 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.136827 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.136949 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.137063 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.137178 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.137178 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.137391 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.137391 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.137613 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.137727 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.137847 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.137963 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.138077 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.138203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.138320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.138434 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.138548 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.138668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.138789 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.138913 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.139028 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.139187 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.139316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.139431 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.139546 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.139669 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.139784 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.139898 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.140015 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.140130 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.140275 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.140404 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.140520 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.140635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.140749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.140870 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.140985 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.141113 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.141230 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.141345 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.141466 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.141582 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.141703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.141828 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.141952 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.142068 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.142191 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.142308 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.142433 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.142549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.142672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.142789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.142913 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.143029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.143168 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.143286 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.143401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.143529 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.143647 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.143761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.143881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.143997 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.144117 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.144241 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.144358 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.144478 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.144595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.144710 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.144830 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.144954 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.145070 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.145185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.145306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.145422 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.145546 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.145662 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.145777 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.145891 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.146012 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.146128 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.146251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.146367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.146488 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.146605 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.146720 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.146835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.146958 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.147075 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.147234 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.147350 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.147465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.147589 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.147715 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.147831 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.147946 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.148060 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.148175 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.148295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.148480 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.148597 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.148720 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.148836 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.148950 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.149065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.149188 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.149314 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.149442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.149569 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.149686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.149802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.149916 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.150042 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.150167 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.150283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.150398 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.150513 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.150628 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.150743 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.150867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.150984 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.151099 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.151238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.151354 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.151469 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.151691 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.152364 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.152507 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.152635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.152838 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.152972 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.152972 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] auth.external = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.153230 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.153348 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.153463 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.153578 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.153703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] auth.external = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.153819 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.153963 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.154094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] auth.password = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.154212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.154329 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] auth.token = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.154445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.154561 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.154685 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] auth.password = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.154803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.154919 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] auth.token = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.155036 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.155177 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.155289 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.155395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.155513 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.155636 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.155753 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.155868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.155992 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.156119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.156236 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] credential.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.156351 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.156466 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.156581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.156703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.156830 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] credential.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.156946 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.157053 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.157167 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.157282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.157398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.157526 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.157644 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.157760 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.157875 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.157991 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.158113 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.158242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.158360 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.158475 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.158598 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.158714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.158830 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.158955 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.159072 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.159235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.159352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.159468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.159584 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.159712 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.159830 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.159949 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.160065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] federation.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.160065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.160283 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.160407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.160524 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.160648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.160771 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] federation.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.160888 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.161004 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.161129 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.161247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.161363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.161479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.161594 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.161710 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.161834 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.161957 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.162074 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.162189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.162314 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.162432 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.162557 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.162674 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.162790 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.162912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.163029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.163162 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.163358 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.163479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.163595 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.163711 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.163826 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.163941 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.164065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.164183 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.164298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.164414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.164530 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.164644 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.164760 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.164896 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.165014 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.165130 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.165246 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.165373 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.165492 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.165609 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.165725 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.165840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.165956 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.166079 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.166197 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.166313 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.166428 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.166545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.166660 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.166785 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.166908 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.167032 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.167170 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.167294 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.167457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.167631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.167770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.167881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.168014 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.168157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.168275 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.168401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.168524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.168650 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.168767 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.168882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.168882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.169111 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.169235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.169235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.169235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.169552 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.169669 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.169794 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.169794 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.170024 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.170148 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.170264 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.170380 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.170516 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.170633 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.170750 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.170866 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.170981 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.171097 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.171242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.171360 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.171476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.171592 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.171708 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.171848 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.171986 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.172110 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.172110 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.172328 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.172328 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.172543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.172667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.172784 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.172901 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.173017 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.173132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.173248 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.173372 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.173496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.173496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.173713 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.173828 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.173945 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.174069 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.174187 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.174187 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.174403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.174403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.174619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.174750 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.174878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.174997 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.175113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.175262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.175377 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.175505 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.175623 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.175747 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.175864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.175981 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.176097 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.176222 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.176339 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.176455 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.176570 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.176685 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.176809 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.176926 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.177044 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.177159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.177274 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.177396 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.177521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.177639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.177755 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.177871 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.177986 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.178103 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.178227 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.178344 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.178460 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.178576 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.178691 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.178807 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.178931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.179048 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.179182 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.179300 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.179416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.179531 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.179659 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.179777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.179897 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.180013 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.180128 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.180244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.180369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.180486 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.180601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.180716 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.180832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.180953 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.181078 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.181196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.181312 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.181427 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.181542 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.181658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.181782 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.181899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.182015 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.182131 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.182253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.182371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.182496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.182613 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.182729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.182845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.183489 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.183612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.183780 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.183917 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.184037 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.184153 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.184269 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.184386 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.184525 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.184657 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] resource.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.184774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.184890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.185005 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.185121 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.185246 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] resource.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.185363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.185480 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.185480 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.185696 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.185812 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.185937 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.186054 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.186170 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.186285 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.186401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.186523 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.186523 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.186816 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.186939 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.186939 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.187221 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.187341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] role.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.187466 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] role.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.187585 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] role.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.187701 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] role.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.187817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.187932 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.188047 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.188172 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.188290 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.188406 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.188523 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.188640 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.188756 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.188880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.188998 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.189115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.189231 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.189347 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.189471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.189590 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.189706 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.189825 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.189941 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.190057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.190180 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.190298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.190413 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.190529 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.190646 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.190762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.190887 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.191004 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.191120 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.191251 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.191367 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.191483 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.191611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.191731 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.191847 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.191963 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.192078 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.192195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.192319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.192437 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.192553 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.192668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.192668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.192885 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.193010 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.193128 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.193245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.193360 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.193476 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.193598 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.193724 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.193842 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.193958 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.194074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.194190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.194305 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.194430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.194548 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.194665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.194781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.194898 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.195022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.195211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.195330 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.195446 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.195562 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.195677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] token.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.195806 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] token.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.195932 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.196049 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.196165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.196281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.196397 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.196521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.196639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.196755 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.196871 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.196988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.197104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.197228 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.197346 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.197462 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.197578 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.197694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.197810 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.197934 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.198053 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.198169 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.198291 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.198408 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.198524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.198720 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.199344 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.199460 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.199577 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.199692 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.199812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.199942 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.200060 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.200177 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.200293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.200409 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.200525 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.connection = **** {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.200655 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.connection = **** {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.200655 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.200897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.201024 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.201143 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.201260 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.201376 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.201493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.201608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.201734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.201851 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.201968 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.202084 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.202084 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.202302 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.202427 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.202545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.202669 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.202786 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.202903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.203018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.203162 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.203282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.203399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.203515 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.203632 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.203748 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.203876 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.203994 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.204110 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.204226 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.204343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.204459 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.204584 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.204701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.204817 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.204933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:55:37.205049 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 18:55:37.205165 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 18:55:37.233437 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.233662 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.233895 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.233979 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.234133 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.234364 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.242546 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.242997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.273387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.273606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.273778 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.274013 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.327020 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.327503 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.376012 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.376245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.377130 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.377370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.444605 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.444782 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.444866 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.444969 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.445049 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.445159 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.445244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.445381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.445475 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.445601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.445683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.445818 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.469411 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.469643 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.469770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.469847 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.469920 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.470054 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.470137 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.470266 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.470380 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.470490 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.470568 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.470681 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.470775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.470893 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.481916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.482137 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.494518 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.494782 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.494923 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.495008 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.495178 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.495262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.495926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.496044 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.496507 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.496584 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.496656 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.496727 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.496810 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.496917 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 18:55:37.514589 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.514797 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 18:55:37.514882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.515099 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 18:55:37.515263 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.515344 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 18:55:37.515549 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.515632 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.515752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 18:55:37.515850 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.516026 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.516108 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.516290 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.516379 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.516552 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.516809 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.527502 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.527776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.527867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.528048 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.528172 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.528328 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.528432 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.528703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.536479 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.536924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.539785 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.540067 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.540242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.540350 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.540522 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.540631 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.540804 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.540911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.541085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.541166 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.541367 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.541448 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.541627 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.541707 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.541897 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.542043 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.542178 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.542827 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.543102 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.543202 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.543570 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.543858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.570097 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.571065 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.571745 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.572021 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.572722 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.573003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.579569 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.579797 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.580081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.580246 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.580528 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.580809 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.587394 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.587677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.588159 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.588443 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.592447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.592733 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.592983 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.593075 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.593274 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.593358 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.593561 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.593643 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.593844 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.593935 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.594177 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.594259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.594448 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.594530 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.594751 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.595023 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.613807 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.614101 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.614409 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.614687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.618817 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.619429 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.623080 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.623392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.623855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.624154 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.628403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.629192 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.632076 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.632845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.635940 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.636273 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.636623 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.636933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.637045 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.637248 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.637330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.637543 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.637626 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.637942 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.638232 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.638521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.656771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.657052 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.657318 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.657580 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.657765 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.658047 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.658315 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.658576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.665621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.666620 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.668074 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.668347 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.669071 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.669348 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.671397 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.671679 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.671968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.672269 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.672455 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.672553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.672737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.673021 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.673306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.673598 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.686562 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.686841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.687148 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.687427 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.687710 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.687950 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.688048 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.688237 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.688329 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.688531 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.688814 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.689106 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.689382 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.689660 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.706136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.707762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.709527 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.711170 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.712917 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.714526 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.714709 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.716263 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.716404 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.716691 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.716974 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.717919 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.718200 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.718483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.724425 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.726045 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.726145 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.727682 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.729310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.729598 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.730403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.730674 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.731473 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.731765 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.732052 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.732331 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.739994 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.740288 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.740567 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.741570 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.741870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.742154 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.749158 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.749436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.749715 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.749995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.750273 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.750543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.750823 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.751088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.751375 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.751652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.751847 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 18:55:37.751941 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.752130 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.752212 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.752425 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.752564 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.752688 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.752779 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.752978 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.753254 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.753535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.753802 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.754079 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.754351 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.754631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.754900 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.755187 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.755457 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 18:55:37.790724 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586ecf0f9c0 pid: 87412 (default app) Jul 25 18:55:37.794472 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586ecf0f9c0 pid: 87413 (default app) Jul 25 18:55:37.794677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773663ff-cb0a-46be-844a-81a6fbb38af8 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:37.794968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773663ff-cb0a-46be-844a-81a6fbb38af8 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:37.795283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773663ff-cb0a-46be-844a-81a6fbb38af8 None None] PATH_INFO: `/v3` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:37.799545 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 1/1] 10.222.0.98 () {50 vars in 791 bytes} [Mon Jul 25 18:55:37 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:55:45.938616 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7e925-ef97-4ae3-9c02-0fbd49e43f19 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:45.939201 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7e925-ef97-4ae3-9c02-0fbd49e43f19 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:45.939201 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7e925-ef97-4ae3-9c02-0fbd49e43f19 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:45.943584 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 1/2] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:55:45.949009 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:45.949451 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:45.949553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:46.126016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: INFO dbcounter [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] Registered counter for database keystone Jul 25 18:55:46.147955 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG oslo_db.sqlalchemy.engines [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 18:55:46.154335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writer thread running {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 18:55:46.333342 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG passlib.handlers.bcrypt [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87412) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 18:55:46.333690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG passlib.handlers.bcrypt [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87412) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 18:55:46.388457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:46.390087 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:46.515406 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 2/3] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 567 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 18:55:46.630053 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7e925-ef97-4ae3-9c02-0fbd49e43f19 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:46.804785 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: INFO dbcounter [None req-b7e7e925-ef97-4ae3-9c02-0fbd49e43f19 None None] Registered counter for database keystone Jul 25 18:55:46.825151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG oslo_db.sqlalchemy.engines [None req-b7e7e925-ef97-4ae3-9c02-0fbd49e43f19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 18:55:46.831411 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writer thread running {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 18:55:46.952526 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7e925-ef97-4ae3-9c02-0fbd49e43f19 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:46.956909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c7be-48ad-4b7b-8896-92bfabb848a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:46.957579 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c7be-48ad-4b7b-8896-92bfabb848a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:46.957867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c7be-48ad-4b7b-8896-92bfabb848a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:46.958148 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c7be-48ad-4b7b-8896-92bfabb848a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:46.966649 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9c7be-48ad-4b7b-8896-92bfabb848a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:47.017737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fad9c7be-48ad-4b7b-8896-92bfabb848a5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 18:55:47.018071 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9c7be-48ad-4b7b-8896-92bfabb848a5 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:47.027455 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 2/4] 10.222.0.98 () {58 vars in 1324 bytes} [Mon Jul 25 18:55:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 18:55:47.033557 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:47.048407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bafa2-72b1-4c71-91f9-8cb01f565db3 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:47.052803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5148f48-7de6-4be8-96f7-5a5a3e12076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:47.053913 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5148f48-7de6-4be8-96f7-5a5a3e12076a admin admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:47.054197 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5148f48-7de6-4be8-96f7-5a5a3e12076a admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:47.054475 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5148f48-7de6-4be8-96f7-5a5a3e12076a admin admin] PATH_INFO: `/v3/projects/32aa335f68034a49832bdfc49717db33` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:47.055947 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5148f48-7de6-4be8-96f7-5a5a3e12076a admin admin] RBAC: Authorizing `identity:get_project(project_id=32aa335f68034a49832bdfc49717db33)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:47.109744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c5148f48-7de6-4be8-96f7-5a5a3e12076a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 18:55:47.110086 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5148f48-7de6-4be8-96f7-5a5a3e12076a admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:47.114690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 3/5] 10.222.0.98 () {56 vars in 1207 bytes} [Mon Jul 25 18:55:47 2022] GET /identity/v3/projects/32aa335f68034a49832bdfc49717db33 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:55:49.314679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0255-0449-4e7a-a49a-5272b3f2c10b None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:49.315246 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0255-0449-4e7a-a49a-5272b3f2c10b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:49.315351 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0255-0449-4e7a-a49a-5272b3f2c10b None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:49.319366 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 3/6] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:55:49.326234 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fedd02-9a66-4797-a4a2-35f18d10e2ed None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:49.326644 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fedd02-9a66-4797-a4a2-35f18d10e2ed None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:49.326805 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fedd02-9a66-4797-a4a2-35f18d10e2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:49.347263 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-01fedd02-9a66-4797-a4a2-35f18d10e2ed None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:49.348795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-01fedd02-9a66-4797-a4a2-35f18d10e2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:49.357305 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 4/7] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 18:55:49.380214 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0255-0449-4e7a-a49a-5272b3f2c10b None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:49.392836 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0255-0449-4e7a-a49a-5272b3f2c10b None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:49.397069 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52b5b-0766-4e39-8274-0d5bdc3a3cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:49.397703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52b5b-0766-4e39-8274-0d5bdc3a3cbf admin admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:49.397990 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52b5b-0766-4e39-8274-0d5bdc3a3cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:49.398269 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52b5b-0766-4e39-8274-0d5bdc3a3cbf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:49.406551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae52b5b-0766-4e39-8274-0d5bdc3a3cbf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:49.408352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae52b5b-0766-4e39-8274-0d5bdc3a3cbf admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:49.417757 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 4/8] 10.222.0.98 () {58 vars in 1324 bytes} [Mon Jul 25 18:55:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 18:55:49.423026 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fedd02-9a66-4797-a4a2-35f18d10e2ed None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:49.432063 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fedd02-9a66-4797-a4a2-35f18d10e2ed None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:49.436542 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8194053-f87a-44df-a885-db9403e57c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:49.437402 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194053-f87a-44df-a885-db9403e57c57 admin admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:49.437696 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194053-f87a-44df-a885-db9403e57c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:49.437979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194053-f87a-44df-a885-db9403e57c57 admin admin] PATH_INFO: `/v3/users/4a14840580b5465f8931c6040356529d` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:49.439398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8194053-f87a-44df-a885-db9403e57c57 admin admin] RBAC: Authorizing `identity:get_user(user_id=4a14840580b5465f8931c6040356529d)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:49.441242 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8194053-f87a-44df-a885-db9403e57c57 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:49.442812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 5/9] 10.222.0.98 () {56 vars in 1198 bytes} [Mon Jul 25 18:55:49 2022] GET /identity/v3/users/4a14840580b5465f8931c6040356529d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:55:51.797156 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c36f55-4c01-4bd8-8101-77c060f4aeb3 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:51.797684 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c36f55-4c01-4bd8-8101-77c060f4aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:51.797784 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c36f55-4c01-4bd8-8101-77c060f4aeb3 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:51.799053 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 5/10] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:55:51.804390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79241583-3e0d-4131-bc44-70ce7496f481 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:51.804814 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79241583-3e0d-4131-bc44-70ce7496f481 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:51.804957 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79241583-3e0d-4131-bc44-70ce7496f481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:51.825552 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-79241583-3e0d-4131-bc44-70ce7496f481 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:51.826742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-79241583-3e0d-4131-bc44-70ce7496f481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:51.852241 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a96a4-3c1c-4d0d-ae32-3ace5c246c19 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:51.853769 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a96a4-3c1c-4d0d-ae32-3ace5c246c19 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:51.854048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a96a4-3c1c-4d0d-ae32-3ace5c246c19 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:51.856048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 6/11] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:55:51.861480 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada26031-5001-4887-9d59-8e88728c8478 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:51.861769 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada26031-5001-4887-9d59-8e88728c8478 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:51.862051 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada26031-5001-4887-9d59-8e88728c8478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:51.907852 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG passlib.handlers.bcrypt [None req-ada26031-5001-4887-9d59-8e88728c8478 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87413) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 18:55:51.908274 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG passlib.handlers.bcrypt [None req-ada26031-5001-4887-9d59-8e88728c8478 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87413) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 18:55:51.923256 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 6/12] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:55:51.949889 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79241583-3e0d-4131-bc44-70ce7496f481 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:51.957699 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-ada26031-5001-4887-9d59-8e88728c8478 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:51.959347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-ada26031-5001-4887-9d59-8e88728c8478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:51.976362 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:52.061630 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79241583-3e0d-4131-bc44-70ce7496f481 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:52.074992 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 7/13] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:55:52.096809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84f8f-9df4-4ef5-b51e-477716f539bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:52.097614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84f8f-9df4-4ef5-b51e-477716f539bd None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:52.097843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada26031-5001-4887-9d59-8e88728c8478 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:52.097954 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84f8f-9df4-4ef5-b51e-477716f539bd None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:52.098168 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84f8f-9df4-4ef5-b51e-477716f539bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:52.110407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e84f8f-9df4-4ef5-b51e-477716f539bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-e1e84f8f-9df4-4ef5-b51e-477716f539bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:55:52.122257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:55:52.123201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:55:52.124438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 7/14] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:55:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:55:52.129246 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84f8f-9df4-4ef5-b51e-477716f539bd None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:52.204088 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada26031-5001-4887-9d59-8e88728c8478 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:52.206353 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:52.214199 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:52.234493 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84f8f-9df4-4ef5-b51e-477716f539bd None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:52.244797 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94a08a-977b-4660-954d-0e83a8384fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:52.245725 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94a08a-977b-4660-954d-0e83a8384fc7 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:52.246019 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94a08a-977b-4660-954d-0e83a8384fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:52.246301 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94a08a-977b-4660-954d-0e83a8384fc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:52.268923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264a858-f314-453a-b210-c3abece0cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:52.269594 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264a858-f314-453a-b210-c3abece0cf70 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:52.269884 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264a858-f314-453a-b210-c3abece0cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:52.270167 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264a858-f314-453a-b210-c3abece0cf70 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:52.270915 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264a858-f314-453a-b210-c3abece0cf70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:55:52.271262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264a858-f314-453a-b210-c3abece0cf70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:52.272682 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264a858-f314-453a-b210-c3abece0cf70 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:52.285281 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 8/15] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:55:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:55:52.290764 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264a858-f314-453a-b210-c3abece0cf70 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:52.315946 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94a08a-977b-4660-954d-0e83a8384fc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:52.317495 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94a08a-977b-4660-954d-0e83a8384fc7 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:52.390895 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264a858-f314-453a-b210-c3abece0cf70 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:52.420702 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 8/16] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 18:55:52.425356 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f22fb-125a-4f75-85b3-01187ffeb5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:52.426230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f22fb-125a-4f75-85b3-01187ffeb5e5 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:52.426386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94a08a-977b-4660-954d-0e83a8384fc7 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:52.426515 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f22fb-125a-4f75-85b3-01187ffeb5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:52.426791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f22fb-125a-4f75-85b3-01187ffeb5e5 None admin] PATH_INFO: `/v3/users/4a14840580b5465f8931c6040356529d` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:52.428033 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f22fb-125a-4f75-85b3-01187ffeb5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=4a14840580b5465f8931c6040356529d)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:52.429228 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:52.429514 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f22fb-125a-4f75-85b3-01187ffeb5e5 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:52.435523 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 9/17] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:55:52 2022] GET /identity/v3/users/4a14840580b5465f8931c6040356529d => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:55:52.436645 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f22fb-125a-4f75-85b3-01187ffeb5e5 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:52.452115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:52.527434 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94a08a-977b-4660-954d-0e83a8384fc7 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:52.536680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f22fb-125a-4f75-85b3-01187ffeb5e5 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:52.560818 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b830eee-8e70-40f9-b4c6-0062c88043b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:52.561615 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b830eee-8e70-40f9-b4c6-0062c88043b8 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:52.561909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b830eee-8e70-40f9-b4c6-0062c88043b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:52.562185 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b830eee-8e70-40f9-b4c6-0062c88043b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:52.570205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a708a-c39c-4ba2-aaea-0f2a61d8221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:52.570994 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a708a-c39c-4ba2-aaea-0f2a61d8221a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:52.571313 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a708a-c39c-4ba2-aaea-0f2a61d8221a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:52.571594 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a708a-c39c-4ba2-aaea-0f2a61d8221a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:52.572775 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a708a-c39c-4ba2-aaea-0f2a61d8221a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:52.574964 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a708a-c39c-4ba2-aaea-0f2a61d8221a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:52.576606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 10/18] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:55:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:55:52.581137 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b830eee-8e70-40f9-b4c6-0062c88043b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:52.582398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a708a-c39c-4ba2-aaea-0f2a61d8221a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:52.582616 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b830eee-8e70-40f9-b4c6-0062c88043b8 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-4b830eee-8e70-40f9-b4c6-0062c88043b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:55:52.604307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:55:52.605281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:55:52.606074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:55:52.606074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:55:52.606074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:55:52.606074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:55:52.606074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 9/19] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:55:52.611513 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b830eee-8e70-40f9-b4c6-0062c88043b8 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:52.667698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:52.670591 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:52.692133 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a708a-c39c-4ba2-aaea-0f2a61d8221a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:52.719151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b830eee-8e70-40f9-b4c6-0062c88043b8 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:52.726726 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2d95c-8420-4909-87fd-b21b16a46240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:52.727419 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2d95c-8420-4909-87fd-b21b16a46240 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:52.727711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2d95c-8420-4909-87fd-b21b16a46240 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:52.727991 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2d95c-8420-4909-87fd-b21b16a46240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:52.728815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2d95c-8420-4909-87fd-b21b16a46240 None admin] RBAC: Adding query filter params (role.id=472a286d91bd484a83e2de07fc231c06, scope.domain.id=default, user.id=4a14840580b5465f8931c6040356529d) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:55:52.729133 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2d95c-8420-4909-87fd-b21b16a46240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:52.730729 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2d95c-8420-4909-87fd-b21b16a46240 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:52.737564 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 11/20] 10.222.0.98 () {56 vars in 1322 bytes} [Mon Jul 25 18:55:52 2022] GET /identity/v3/role_assignments?user.id=4a14840580b5465f8931c6040356529d&scope.domain.id=default&role.id=472a286d91bd484a83e2de07fc231c06 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:55:52.753045 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b020a5-a14d-4aa9-ae6f-ec969debbbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:52.753738 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b020a5-a14d-4aa9-ae6f-ec969debbbd5 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:52.754026 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b020a5-a14d-4aa9-ae6f-ec969debbbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:52.754306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b020a5-a14d-4aa9-ae6f-ec969debbbd5 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:52.755050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b020a5-a14d-4aa9-ae6f-ec969debbbd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:55:52.755414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b020a5-a14d-4aa9-ae6f-ec969debbbd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:52.756935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b020a5-a14d-4aa9-ae6f-ec969debbbd5 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:52.778399 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 10/21] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:55:55.464886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab48b16-2f12-4010-b05d-6ede9e6f84a8 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:55.465890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab48b16-2f12-4010-b05d-6ede9e6f84a8 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:55.466389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab48b16-2f12-4010-b05d-6ede9e6f84a8 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:55.468014 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 12/22] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:55:55.473721 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17080-82df-42af-bd40-bdf52499331e None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:55.474654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17080-82df-42af-bd40-bdf52499331e None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:55.475171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17080-82df-42af-bd40-bdf52499331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:55.484633 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209439c-b959-4f9a-b797-fd5b1ed113b3 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:55.485225 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209439c-b959-4f9a-b797-fd5b1ed113b3 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:55.485721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209439c-b959-4f9a-b797-fd5b1ed113b3 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:55.487298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 13/23] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:55:55.492341 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4749a-f582-456a-b514-e80764abf2aa None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:55.492859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4749a-f582-456a-b514-e80764abf2aa None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:55.493379 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4749a-f582-456a-b514-e80764abf2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:55.517376 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-f6c17080-82df-42af-bd40-bdf52499331e None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:55.519158 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-f6c17080-82df-42af-bd40-bdf52499331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:55.527098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-85f4749a-f582-456a-b514-e80764abf2aa None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:55.528579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-85f4749a-f582-456a-b514-e80764abf2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:55.649456 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 14/24] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:55:55.651298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ff3de-64b1-4256-a9ca-b526d3e5f455 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:55.652293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ff3de-64b1-4256-a9ca-b526d3e5f455 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:55.652777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ff3de-64b1-4256-a9ca-b526d3e5f455 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:55.654288 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 15/25] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:55:55.668527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 11/26] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:55:55.673976 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e928891-8933-4410-a102-974a6b24921e None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:55.674459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e928891-8933-4410-a102-974a6b24921e None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:55.674940 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e928891-8933-4410-a102-974a6b24921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:55.688705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c17080-82df-42af-bd40-bdf52499331e None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:55.712180 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-5e928891-8933-4410-a102-974a6b24921e None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:55.713398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-5e928891-8933-4410-a102-974a6b24921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:55.755812 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:55.840600 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c17080-82df-42af-bd40-bdf52499331e None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:55.851100 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 16/27] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:55:55.853100 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e928891-8933-4410-a102-974a6b24921e None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:55.861389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:55.879470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb42e-2edd-4676-ab3a-9f75b248744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:55.880626 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb42e-2edd-4676-ab3a-9f75b248744c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:55.881113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb42e-2edd-4676-ab3a-9f75b248744c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:55.881590 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb42e-2edd-4676-ab3a-9f75b248744c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:55.894212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb42e-2edd-4676-ab3a-9f75b248744c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-04aeb42e-2edd-4676-ab3a-9f75b248744c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:55:55.903611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:55:55.904508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:55:55.905259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:55:55.907691 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 12/28] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:55:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:55:55.908689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb42e-2edd-4676-ab3a-9f75b248744c None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:56.016067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb42e-2edd-4676-ab3a-9f75b248744c None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:56.023815 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:56.053764 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec549d07-428d-46be-b0b1-02185c650f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:56.054780 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec549d07-428d-46be-b0b1-02185c650f86 None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:56.055297 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec549d07-428d-46be-b0b1-02185c650f86 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:56.055797 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec549d07-428d-46be-b0b1-02185c650f86 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:56.056729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec549d07-428d-46be-b0b1-02185c650f86 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:56.058867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec549d07-428d-46be-b0b1-02185c650f86 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:56.070037 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e928891-8933-4410-a102-974a6b24921e None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:56.140184 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3213786-99da-4a58-a5e5-c028223b3b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:56.141335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3213786-99da-4a58-a5e5-c028223b3b9f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:56.141846 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3213786-99da-4a58-a5e5-c028223b3b9f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:56.142379 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3213786-99da-4a58-a5e5-c028223b3b9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:56.168951 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3213786-99da-4a58-a5e5-c028223b3b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:56.170899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3213786-99da-4a58-a5e5-c028223b3b9f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-e3213786-99da-4a58-a5e5-c028223b3b9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:55:56.200742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:55:56.201615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:55:56.202450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:55:56.202450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:55:56.202450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:55:56.202450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:55:56.202450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 17/29] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:55:56.203160 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3213786-99da-4a58-a5e5-c028223b3b9f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:56.268692 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 13/30] 10.222.0.98 () {60 vars in 1131 bytes} [Mon Jul 25 18:55:55 2022] POST /identity/v3/roles => generated 219 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:55:56.270028 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec549d07-428d-46be-b0b1-02185c650f86 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:56.327055 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:56.430421 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec549d07-428d-46be-b0b1-02185c650f86 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:56.461416 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3213786-99da-4a58-a5e5-c028223b3b9f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:56.483291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d900e-1bb0-4319-bc77-b7a6a9561a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:56.484736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d900e-1bb0-4319-bc77-b7a6a9561a06 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:56.485703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d900e-1bb0-4319-bc77-b7a6a9561a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:56.486184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d900e-1bb0-4319-bc77-b7a6a9561a06 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:56.487621 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d900e-1bb0-4319-bc77-b7a6a9561a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:55:56.488137 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d900e-1bb0-4319-bc77-b7a6a9561a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:56.489889 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d900e-1bb0-4319-bc77-b7a6a9561a06 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:56.515292 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 14/31] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:55:56.530731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d900e-1bb0-4319-bc77-b7a6a9561a06 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:56.538843 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18d1c-396e-422f-8106-aeb21dee4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:56.539556 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18d1c-396e-422f-8106-aeb21dee4a2d None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:56.539850 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18d1c-396e-422f-8106-aeb21dee4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:56.540188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18d1c-396e-422f-8106-aeb21dee4a2d None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:56.540895 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b18d1c-396e-422f-8106-aeb21dee4a2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:55:56.541210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b18d1c-396e-422f-8106-aeb21dee4a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:56.543285 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b18d1c-396e-422f-8106-aeb21dee4a2d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:56.552584 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 18/32] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:55:56.559158 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ac602-da97-4d85-9c61-0f6862a05549 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:56.559158 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ac602-da97-4d85-9c61-0f6862a05549 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:56.559158 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ac602-da97-4d85-9c61-0f6862a05549 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:56.561532 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 19/33] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:55:56.562429 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ac602-da97-4d85-9c61-0f6862a05549 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:56.592468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:56.721310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d900e-1bb0-4319-bc77-b7a6a9561a06 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:56.727773 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ac602-da97-4d85-9c61-0f6862a05549 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:56.752506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:56.774653 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403945-003d-46c8-83a3-be1e32fb0598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:56.775393 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403945-003d-46c8-83a3-be1e32fb0598 None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:56.775697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403945-003d-46c8-83a3-be1e32fb0598 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:56.775969 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403945-003d-46c8-83a3-be1e32fb0598 None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:56.777157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6403945-003d-46c8-83a3-be1e32fb0598 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:56.778269 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fe0fd-0bec-4031-87f7-b3493fa20e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:56.778655 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6403945-003d-46c8-83a3-be1e32fb0598 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:56.779638 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fe0fd-0bec-4031-87f7-b3493fa20e0b None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:56.780130 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fe0fd-0bec-4031-87f7-b3493fa20e0b None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:56.780606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fe0fd-0bec-4031-87f7-b3493fa20e0b None admin] PATH_INFO: `/v3/users/4a14840580b5465f8931c6040356529d` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:56.782343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fe0fd-0bec-4031-87f7-b3493fa20e0b None admin] RBAC: Authorizing `identity:get_user(user_id=4a14840580b5465f8931c6040356529d)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:56.784501 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fe0fd-0bec-4031-87f7-b3493fa20e0b None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:56.786439 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 20/34] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:55:56 2022] GET /identity/v3/users/4a14840580b5465f8931c6040356529d => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:55:56.788652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedaec9-ffcd-499f-8a6e-ce6d1a969c66 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:56.789244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedaec9-ffcd-499f-8a6e-ce6d1a969c66 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:56.789784 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedaec9-ffcd-499f-8a6e-ce6d1a969c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:56.816196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-5aedaec9-ffcd-499f-8a6e-ce6d1a969c66 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:56.817905 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-5aedaec9-ffcd-499f-8a6e-ce6d1a969c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:56.825147 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 15/35] 10.222.0.98 () {60 vars in 1141 bytes} [Mon Jul 25 18:55:56 2022] POST /identity/v3/projects => generated 301 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 18:55:56.826074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403945-003d-46c8-83a3-be1e32fb0598 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:56.910612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 21/36] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:55:56.917410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102217e-027f-463d-8efa-55b0dae2e7ef None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:56.918261 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102217e-027f-463d-8efa-55b0dae2e7ef None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:56.918753 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102217e-027f-463d-8efa-55b0dae2e7ef None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:56.920568 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 22/37] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:55:56.926387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491ef36-2f01-411c-873b-076e50dd9111 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:56.927010 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491ef36-2f01-411c-873b-076e50dd9111 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:56.927530 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491ef36-2f01-411c-873b-076e50dd9111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:56.946277 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:56.964175 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-5491ef36-2f01-411c-873b-076e50dd9111 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:56.965923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-5491ef36-2f01-411c-873b-076e50dd9111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:56.975872 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403945-003d-46c8-83a3-be1e32fb0598 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:57.029916 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1fda-f99e-4a01-8d33-e91f39da5ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:57.030761 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1fda-f99e-4a01-8d33-e91f39da5ae0 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:57.031050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1fda-f99e-4a01-8d33-e91f39da5ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:57.031357 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1fda-f99e-4a01-8d33-e91f39da5ae0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:57.033426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b1fda-f99e-4a01-8d33-e91f39da5ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:57.034875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b1fda-f99e-4a01-8d33-e91f39da5ae0 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:57.036855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 16/38] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:55:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:55:57.042974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1fda-f99e-4a01-8d33-e91f39da5ae0 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:57.064411 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 23/39] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:55:57.065808 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491ef36-2f01-411c-873b-076e50dd9111 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:57.126733 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:57.165369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1fda-f99e-4a01-8d33-e91f39da5ae0 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:57.188302 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491ef36-2f01-411c-873b-076e50dd9111 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:57.202319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584ab8b-dc6b-4453-8956-a53b5d79c214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:57.203042 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584ab8b-dc6b-4453-8956-a53b5d79c214 None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:57.203370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584ab8b-dc6b-4453-8956-a53b5d79c214 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:57.203657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584ab8b-dc6b-4453-8956-a53b5d79c214 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:57.204406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584ab8b-dc6b-4453-8956-a53b5d79c214 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:57.205811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584ab8b-dc6b-4453-8956-a53b5d79c214 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:57.219671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 17/40] 10.222.0.98 () {60 vars in 1131 bytes} [Mon Jul 25 18:55:57 2022] POST /identity/v3/roles => generated 225 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:55:57.220565 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584ab8b-dc6b-4453-8956-a53b5d79c214 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:57.225873 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cc9c9-55e7-48c3-8970-820cf20fe462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:57.226782 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cc9c9-55e7-48c3-8970-820cf20fe462 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:57.227071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cc9c9-55e7-48c3-8970-820cf20fe462 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:57.227398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cc9c9-55e7-48c3-8970-820cf20fe462 None admin] PATH_INFO: `/v3/domains/default/users/4a14840580b5465f8931c6040356529d/roles/472a286d91bd484a83e2de07fc231c06` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:57.230262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cc9c9-55e7-48c3-8970-820cf20fe462 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4a14840580b5465f8931c6040356529d, role_id=472a286d91bd484a83e2de07fc231c06)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:57.231832 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cc9c9-55e7-48c3-8970-820cf20fe462 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:57.235189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:57.346389 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584ab8b-dc6b-4453-8956-a53b5d79c214 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:57.359793 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 24/41] 10.222.0.98 () {58 vars in 1361 bytes} [Mon Jul 25 18:55:57 2022] PUT /identity/v3/domains/default/users/4a14840580b5465f8931c6040356529d/roles/472a286d91bd484a83e2de07fc231c06 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:55:57.367551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c36ca5-6d58-48a0-89a0-be2423b45d6f None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:57.367551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c36ca5-6d58-48a0-89a0-be2423b45d6f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:57.367551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c36ca5-6d58-48a0-89a0-be2423b45d6f None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:57.367551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 25/42] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:55:57.374049 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d86ad-c245-46f0-ab6e-9b1d2fdec2a0 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:57.374431 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d86ad-c245-46f0-ab6e-9b1d2fdec2a0 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:57.374631 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d86ad-c245-46f0-ab6e-9b1d2fdec2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:57.399250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-f24d86ad-c245-46f0-ab6e-9b1d2fdec2a0 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:57.400859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-f24d86ad-c245-46f0-ab6e-9b1d2fdec2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:57.411664 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56f806-4fa1-4be4-b067-f253f99bc933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:57.412501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f806-4fa1-4be4-b067-f253f99bc933 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:57.412796 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f806-4fa1-4be4-b067-f253f99bc933 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:57.414358 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f806-4fa1-4be4-b067-f253f99bc933 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:57.417974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56f806-4fa1-4be4-b067-f253f99bc933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:57.419429 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56f806-4fa1-4be4-b067-f253f99bc933 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:57.422492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 18/43] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:55:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:55:57.428385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56f806-4fa1-4be4-b067-f253f99bc933 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:57.506244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 26/44] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:55:57.526093 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:57.531552 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d86ad-c245-46f0-ab6e-9b1d2fdec2a0 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:57.558305 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56f806-4fa1-4be4-b067-f253f99bc933 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:57.571701 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:57.597070 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca353102-accd-42a6-84b6-a395d7d7457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:57.597659 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca353102-accd-42a6-84b6-a395d7d7457a None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:57.597942 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca353102-accd-42a6-84b6-a395d7d7457a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:57.598219 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca353102-accd-42a6-84b6-a395d7d7457a None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:57.598948 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca353102-accd-42a6-84b6-a395d7d7457a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:57.600422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca353102-accd-42a6-84b6-a395d7d7457a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:57.629327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 19/45] 10.222.0.98 () {60 vars in 1141 bytes} [Mon Jul 25 18:55:57 2022] POST /identity/v3/projects => generated 312 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 18:55:57.650466 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d86ad-c245-46f0-ab6e-9b1d2fdec2a0 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:57.699198 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839e891-660b-47d9-9345-76c99c84762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:57.700200 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839e891-660b-47d9-9345-76c99c84762d None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:57.700637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839e891-660b-47d9-9345-76c99c84762d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:57.701065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839e891-660b-47d9-9345-76c99c84762d None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:57.702020 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839e891-660b-47d9-9345-76c99c84762d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:55:57.703795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839e891-660b-47d9-9345-76c99c84762d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:55:57.727450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 27/46] 10.222.0.98 () {60 vars in 1131 bytes} [Mon Jul 25 18:55:57 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 18:55:59.649774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524728d-d347-4a5c-ab22-bc23af233de0 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:59.650327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524728d-d347-4a5c-ab22-bc23af233de0 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:59.650327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524728d-d347-4a5c-ab22-bc23af233de0 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:59.653056 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 20/47] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:55:59.658255 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020820c7-e198-452c-95db-eff12f2db6d2 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:59.658687 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020820c7-e198-452c-95db-eff12f2db6d2 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:59.658827 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020820c7-e198-452c-95db-eff12f2db6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:59.677364 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-020820c7-e198-452c-95db-eff12f2db6d2 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:59.678572 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-020820c7-e198-452c-95db-eff12f2db6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:59.749043 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 28/48] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:55:59.773667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524728d-d347-4a5c-ab22-bc23af233de0 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:59.878015 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524728d-d347-4a5c-ab22-bc23af233de0 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:55:59.905968 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:59.915682 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ec23-5f6a-4b4f-936a-9b7d1a937e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:55:59.916698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ec23-5f6a-4b4f-936a-9b7d1a937e9b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:59.917345 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ec23-5f6a-4b4f-936a-9b7d1a937e9b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:59.917640 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ec23-5f6a-4b4f-936a-9b7d1a937e9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:59.927657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03ec23-5f6a-4b4f-936a-9b7d1a937e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-ed03ec23-5f6a-4b4f-936a-9b7d1a937e9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:55:59.935834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:55:59.936855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:55:59.937803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 21/49] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:55:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:55:59.941777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242547c-5057-4844-bf3a-ade20a9e9a88 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:59.942149 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242547c-5057-4844-bf3a-ade20a9e9a88 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:59.942508 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242547c-5057-4844-bf3a-ade20a9e9a88 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:59.942598 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ec23-5f6a-4b4f-936a-9b7d1a937e9b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:55:59.944042 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 29/50] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:55:59.949726 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2a5c0-1121-428e-926f-4ab8f062f0dd None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:55:59.950019 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2a5c0-1121-428e-926f-4ab8f062f0dd None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:55:59.950302 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2a5c0-1121-428e-926f-4ab8f062f0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:55:59.967961 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-79e2a5c0-1121-428e-926f-4ab8f062f0dd None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:55:59.969173 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-79e2a5c0-1121-428e-926f-4ab8f062f0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:55:59.990453 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:00.039893 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 30/51] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:00.051636 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ec23-5f6a-4b4f-936a-9b7d1a937e9b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:00.064913 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2a5c0-1121-428e-926f-4ab8f062f0dd None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:00.086400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7f320-4b15-4a1f-975f-e0d9d24dc480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:00.087077 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f320-4b15-4a1f-975f-e0d9d24dc480 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:00.087400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f320-4b15-4a1f-975f-e0d9d24dc480 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:00.087684 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f320-4b15-4a1f-975f-e0d9d24dc480 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:00.089105 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f320-4b15-4a1f-975f-e0d9d24dc480 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:00.089349 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f320-4b15-4a1f-975f-e0d9d24dc480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:00.090719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f320-4b15-4a1f-975f-e0d9d24dc480 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:00.103163 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 22/52] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:55:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:00.108913 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7f320-4b15-4a1f-975f-e0d9d24dc480 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:00.157153 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:00.166058 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2a5c0-1121-428e-926f-4ab8f062f0dd None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:00.200449 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4106863-8d73-42e4-9a57-5da10c7305b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:00.201235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4106863-8d73-42e4-9a57-5da10c7305b9 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:00.201524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4106863-8d73-42e4-9a57-5da10c7305b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:00.201806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4106863-8d73-42e4-9a57-5da10c7305b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:00.202989 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4106863-8d73-42e4-9a57-5da10c7305b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:00.204506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4106863-8d73-42e4-9a57-5da10c7305b9 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:00.206122 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 31/53] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:00.208453 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7f320-4b15-4a1f-975f-e0d9d24dc480 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:00.211664 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4106863-8d73-42e4-9a57-5da10c7305b9 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:00.238223 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:00.243642 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8875e-117e-4ef0-bb67-e0434433d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:00.244526 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8875e-117e-4ef0-bb67-e0434433d200 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:00.244849 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8875e-117e-4ef0-bb67-e0434433d200 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:00.245129 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8875e-117e-4ef0-bb67-e0434433d200 None admin] PATH_INFO: `/v3/users/4a14840580b5465f8931c6040356529d` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:00.246574 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8875e-117e-4ef0-bb67-e0434433d200 None admin] RBAC: Authorizing `identity:get_user(user_id=4a14840580b5465f8931c6040356529d)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:00.248049 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8875e-117e-4ef0-bb67-e0434433d200 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:00.249699 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 23/54] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:00 2022] GET /identity/v3/users/4a14840580b5465f8931c6040356529d => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:00.255055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8875e-117e-4ef0-bb67-e0434433d200 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:00.316927 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4106863-8d73-42e4-9a57-5da10c7305b9 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:00.351024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa74146-caea-49d5-990c-733b917c6e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:00.351720 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa74146-caea-49d5-990c-733b917c6e9a None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:00.352011 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa74146-caea-49d5-990c-733b917c6e9a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:00.352295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa74146-caea-49d5-990c-733b917c6e9a None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:00.352995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa74146-caea-49d5-990c-733b917c6e9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:00.354688 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa74146-caea-49d5-990c-733b917c6e9a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:00.357289 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8875e-117e-4ef0-bb67-e0434433d200 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:00.373467 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:00.382915 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 32/55] 10.222.0.98 () {60 vars in 1140 bytes} [Mon Jul 25 18:56:00 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 18:56:00.393395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ab9ab-8d3d-4966-9fa5-368c57dab94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:00.394225 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ab9ab-8d3d-4966-9fa5-368c57dab94a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:00.394551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ab9ab-8d3d-4966-9fa5-368c57dab94a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:00.394840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ab9ab-8d3d-4966-9fa5-368c57dab94a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:00.396152 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ab9ab-8d3d-4966-9fa5-368c57dab94a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:00.397730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ab9ab-8d3d-4966-9fa5-368c57dab94a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:00.399502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 24/56] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:00.406609 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa74146-caea-49d5-990c-733b917c6e9a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:00.490429 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:00.517242 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa74146-caea-49d5-990c-733b917c6e9a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:00.552266 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34955be8-2f52-4313-9e9d-55a1fe5d6584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:00.553187 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34955be8-2f52-4313-9e9d-55a1fe5d6584 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:00.553187 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34955be8-2f52-4313-9e9d-55a1fe5d6584 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:00.553484 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34955be8-2f52-4313-9e9d-55a1fe5d6584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:00.554639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34955be8-2f52-4313-9e9d-55a1fe5d6584 None admin] RBAC: Adding query filter params (role.id=472a286d91bd484a83e2de07fc231c06, scope.domain.id=default, user.id=4a14840580b5465f8931c6040356529d) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:00.554639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34955be8-2f52-4313-9e9d-55a1fe5d6584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:00.556114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34955be8-2f52-4313-9e9d-55a1fe5d6584 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:00.562624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 33/57] 10.222.0.98 () {56 vars in 1322 bytes} [Mon Jul 25 18:56:00 2022] GET /identity/v3/role_assignments?user.id=4a14840580b5465f8931c6040356529d&scope.domain.id=default&role.id=472a286d91bd484a83e2de07fc231c06 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:02.642882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393e1d5-04af-4b1e-b6bf-3c66fd65ce3b None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:02.643425 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393e1d5-04af-4b1e-b6bf-3c66fd65ce3b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:02.643532 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393e1d5-04af-4b1e-b6bf-3c66fd65ce3b None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:02.644841 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 25/58] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:02.649899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112a7a4-4ed6-4a79-a59f-a43ea7fa13ca None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:02.650265 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112a7a4-4ed6-4a79-a59f-a43ea7fa13ca None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:02.650473 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112a7a4-4ed6-4a79-a59f-a43ea7fa13ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:02.668840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-4112a7a4-4ed6-4a79-a59f-a43ea7fa13ca None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:02.670037 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-4112a7a4-4ed6-4a79-a59f-a43ea7fa13ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:02.741689 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 34/59] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:02.768036 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393e1d5-04af-4b1e-b6bf-3c66fd65ce3b None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:02.879858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393e1d5-04af-4b1e-b6bf-3c66fd65ce3b None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:02.915851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42731f-690f-4b7e-bd06-f6652a44697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:02.917196 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42731f-690f-4b7e-bd06-f6652a44697b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:02.917493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42731f-690f-4b7e-bd06-f6652a44697b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:02.917772 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42731f-690f-4b7e-bd06-f6652a44697b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:02.919381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42731f-690f-4b7e-bd06-f6652a44697b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:02.920839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42731f-690f-4b7e-bd06-f6652a44697b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:02.922445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 26/60] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:02.928024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112a7a4-4ed6-4a79-a59f-a43ea7fa13ca None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:03.001525 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:03.031643 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112a7a4-4ed6-4a79-a59f-a43ea7fa13ca None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:03.064655 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fa810-7540-4b45-b4fe-c9439d31d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:03.065324 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fa810-7540-4b45-b4fe-c9439d31d14c None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:03.065611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fa810-7540-4b45-b4fe-c9439d31d14c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:03.065891 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fa810-7540-4b45-b4fe-c9439d31d14c None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:03.066605 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fa810-7540-4b45-b4fe-c9439d31d14c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:03.068112 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fa810-7540-4b45-b4fe-c9439d31d14c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:03.094464 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 35/61] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:56:02 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:56:06.451001 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e62cdb-0217-49f0-968b-6c4b642681e5 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:06.452056 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e62cdb-0217-49f0-968b-6c4b642681e5 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:06.452554 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e62cdb-0217-49f0-968b-6c4b642681e5 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:06.454140 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 27/62] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:06.459458 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27930ea-bc66-4f32-b84c-beba199f51dc None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:06.460283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27930ea-bc66-4f32-b84c-beba199f51dc None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:06.460770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27930ea-bc66-4f32-b84c-beba199f51dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:06.488713 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-a27930ea-bc66-4f32-b84c-beba199f51dc None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:06.490342 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-a27930ea-bc66-4f32-b84c-beba199f51dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:06.588684 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 36/63] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:06.619000 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e62cdb-0217-49f0-968b-6c4b642681e5 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:06.695154 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:06.721365 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20e05b-912d-434c-83dd-1f2e31d30b96 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:06.721988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20e05b-912d-434c-83dd-1f2e31d30b96 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:06.722498 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20e05b-912d-434c-83dd-1f2e31d30b96 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:06.724216 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 37/64] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:06.730220 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae61b-b0c0-49c2-9de1-6991de8d1900 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:06.730863 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae61b-b0c0-49c2-9de1-6991de8d1900 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:06.731493 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae61b-b0c0-49c2-9de1-6991de8d1900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:06.764235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-505ae61b-b0c0-49c2-9de1-6991de8d1900 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:06.765679 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-505ae61b-b0c0-49c2-9de1-6991de8d1900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:06.789254 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e62cdb-0217-49f0-968b-6c4b642681e5 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:06.835736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b06a2-9971-4c8b-a5e5-2518abe0da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:06.836545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b06a2-9971-4c8b-a5e5-2518abe0da2a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:06.836839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b06a2-9971-4c8b-a5e5-2518abe0da2a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:06.837124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b06a2-9971-4c8b-a5e5-2518abe0da2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:06.863770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b06a2-9971-4c8b-a5e5-2518abe0da2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-143b06a2-9971-4c8b-a5e5-2518abe0da2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:06.873514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:06.874606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:06.875551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:06.881373 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 28/65] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:06.882840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731de1c-a136-4e2b-b279-223b17ba5aaf None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:06.887262 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731de1c-a136-4e2b-b279-223b17ba5aaf None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:06.887262 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731de1c-a136-4e2b-b279-223b17ba5aaf None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:06.887262 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 29/66] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:06.889849 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731de1c-a136-4e2b-b279-223b17ba5aaf None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:06.892956 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:06.919357 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 38/67] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:56:06.921733 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72f9e-b6b3-4524-9c74-cecb940fcbd5 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:06.922549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72f9e-b6b3-4524-9c74-cecb940fcbd5 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:06.923039 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72f9e-b6b3-4524-9c74-cecb940fcbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:06.949944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-72d72f9e-b6b3-4524-9c74-cecb940fcbd5 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:06.951848 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-72d72f9e-b6b3-4524-9c74-cecb940fcbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:07.013183 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731de1c-a136-4e2b-b279-223b17ba5aaf None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:07.027910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:07.049511 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 39/68] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:07.050782 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d72f9e-b6b3-4524-9c74-cecb940fcbd5 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:07.056843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670cf96-8058-4fbe-a5e5-210f3991915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:07.057597 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670cf96-8058-4fbe-a5e5-210f3991915d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.057977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670cf96-8058-4fbe-a5e5-210f3991915d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.058268 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670cf96-8058-4fbe-a5e5-210f3991915d None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.059026 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670cf96-8058-4fbe-a5e5-210f3991915d None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:07.059366 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670cf96-8058-4fbe-a5e5-210f3991915d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:07.060779 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670cf96-8058-4fbe-a5e5-210f3991915d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:07.079043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 30/69] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:07.084673 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670cf96-8058-4fbe-a5e5-210f3991915d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:07.164687 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d72f9e-b6b3-4524-9c74-cecb940fcbd5 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:07.184020 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:07.205125 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49154de-59f2-4cd6-920f-0b64922ca23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:07.205936 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49154de-59f2-4cd6-920f-0b64922ca23c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.206215 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49154de-59f2-4cd6-920f-0b64922ca23c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.206501 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49154de-59f2-4cd6-920f-0b64922ca23c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.210737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670cf96-8058-4fbe-a5e5-210f3991915d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:07.217796 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49154de-59f2-4cd6-920f-0b64922ca23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-b49154de-59f2-4cd6-920f-0b64922ca23c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:07.225538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:07.226390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:07.227159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 40/70] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:07.227796 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49154de-59f2-4cd6-920f-0b64922ca23c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:07.254423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ad325-d092-4fe6-9916-d6163b55473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:07.255341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad325-d092-4fe6-9916-d6163b55473f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.255632 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad325-d092-4fe6-9916-d6163b55473f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.255915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad325-d092-4fe6-9916-d6163b55473f None admin] PATH_INFO: `/v3/users/a751b52fcf40400e8553295a7aac987f` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.272043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ad325-d092-4fe6-9916-d6163b55473f None admin] RBAC: Authorizing `identity:get_user(user_id=a751b52fcf40400e8553295a7aac987f)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:07.273434 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ad325-d092-4fe6-9916-d6163b55473f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:07.275151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 31/71] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/users/a751b52fcf40400e8553295a7aac987f => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:07.281402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb619b-3cb8-42c0-b03d-51a89df5f404 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.281700 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb619b-3cb8-42c0-b03d-51a89df5f404 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.282108 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb619b-3cb8-42c0-b03d-51a89df5f404 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.283383 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 32/72] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:07.284099 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb619b-3cb8-42c0-b03d-51a89df5f404 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:07.317450 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:07.341049 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49154de-59f2-4cd6-920f-0b64922ca23c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:07.374723 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b0b91-b12c-42a4-8671-c07120335b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:07.375559 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b0b91-b12c-42a4-8671-c07120335b60 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.375849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b0b91-b12c-42a4-8671-c07120335b60 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.376129 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b0b91-b12c-42a4-8671-c07120335b60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.386607 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b0b91-b12c-42a4-8671-c07120335b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:07.390182 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb619b-3cb8-42c0-b03d-51a89df5f404 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-b51b0b91-b12c-42a4-8671-c07120335b60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:07.394611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:07.395672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:07.396459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 41/73] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:07.397074 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b0b91-b12c-42a4-8671-c07120335b60 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:07.428295 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a814d18-8baf-44bd-b613-8c7c3e38bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:07.428966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a814d18-8baf-44bd-b613-8c7c3e38bc79 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.429254 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a814d18-8baf-44bd-b613-8c7c3e38bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.429545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a814d18-8baf-44bd-b613-8c7c3e38bc79 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.430288 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a814d18-8baf-44bd-b613-8c7c3e38bc79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:07.430596 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a814d18-8baf-44bd-b613-8c7c3e38bc79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:07.432034 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a814d18-8baf-44bd-b613-8c7c3e38bc79 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:07.435618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:07.440499 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 33/74] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:07.441709 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbdf73-2f1d-416b-85b0-246e7cd190dc None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.442003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbdf73-2f1d-416b-85b0-246e7cd190dc None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.442283 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbdf73-2f1d-416b-85b0-246e7cd190dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.459517 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-04fbdf73-2f1d-416b-85b0-246e7cd190dc None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:07.461045 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-04fbdf73-2f1d-416b-85b0-246e7cd190dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:07.506080 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b0b91-b12c-42a4-8671-c07120335b60 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:07.529484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 34/75] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:07.531004 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795acb63-d972-4519-86aa-91c1bb91bb6b None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.531344 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795acb63-d972-4519-86aa-91c1bb91bb6b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.531620 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795acb63-d972-4519-86aa-91c1bb91bb6b None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.533016 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 35/76] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:07.533593 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795acb63-d972-4519-86aa-91c1bb91bb6b None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:07.550053 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97ae78-c794-4d4b-a0d2-0c7d67bd87ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:07.550868 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97ae78-c794-4d4b-a0d2-0c7d67bd87ea None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.551551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97ae78-c794-4d4b-a0d2-0c7d67bd87ea None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.551852 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97ae78-c794-4d4b-a0d2-0c7d67bd87ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.561315 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:07.620016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97ae78-c794-4d4b-a0d2-0c7d67bd87ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:07.621516 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97ae78-c794-4d4b-a0d2-0c7d67bd87ea None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:07.639337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795acb63-d972-4519-86aa-91c1bb91bb6b None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:07.655842 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:07.673498 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58b77-b558-4c9e-9315-147199cb4503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:07.674174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58b77-b558-4c9e-9315-147199cb4503 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.674459 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58b77-b558-4c9e-9315-147199cb4503 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.674736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58b77-b558-4c9e-9315-147199cb4503 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.675511 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c58b77-b558-4c9e-9315-147199cb4503 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:07.675821 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c58b77-b558-4c9e-9315-147199cb4503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:07.677455 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c58b77-b558-4c9e-9315-147199cb4503 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:07.685205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 36/77] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:07.688213 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58b77-b558-4c9e-9315-147199cb4503 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:07.727740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 42/78] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:07.729136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1469e44-7b65-49c6-8329-0cc71b56a85a None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.729425 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1469e44-7b65-49c6-8329-0cc71b56a85a None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.729703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1469e44-7b65-49c6-8329-0cc71b56a85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.747445 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-b1469e44-7b65-49c6-8329-0cc71b56a85a None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:07.748650 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-b1469e44-7b65-49c6-8329-0cc71b56a85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:07.778220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:07.793134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58b77-b558-4c9e-9315-147199cb4503 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:07.815649 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 43/79] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:07.824548 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1469e44-7b65-49c6-8329-0cc71b56a85a None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:07.827069 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffaf06-c692-4f0b-9677-d7be04813c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:07.827993 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffaf06-c692-4f0b-9677-d7be04813c5a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.828285 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffaf06-c692-4f0b-9677-d7be04813c5a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.828568 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffaf06-c692-4f0b-9677-d7be04813c5a None admin] PATH_INFO: `/v3/users/4a14840580b5465f8931c6040356529d` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.829784 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffaf06-c692-4f0b-9677-d7be04813c5a None admin] RBAC: Authorizing `identity:get_user(user_id=4a14840580b5465f8931c6040356529d)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:07.831262 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffaf06-c692-4f0b-9677-d7be04813c5a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:07.832901 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 37/80] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/users/4a14840580b5465f8931c6040356529d => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:07.833646 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffaf06-c692-4f0b-9677-d7be04813c5a None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:07.893728 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:07.931430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1469e44-7b65-49c6-8329-0cc71b56a85a None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:07.937632 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffaf06-c692-4f0b-9677-d7be04813c5a None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:07.965731 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e536990-d16c-4b63-9aad-c9e92f692a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:07.966526 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e536990-d16c-4b63-9aad-c9e92f692a0c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.966821 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e536990-d16c-4b63-9aad-c9e92f692a0c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.967104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e536990-d16c-4b63-9aad-c9e92f692a0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.971682 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86977e56-f833-4f9d-adc7-1a9d3296825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:07.972553 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977e56-f833-4f9d-adc7-1a9d3296825c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:07.972844 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977e56-f833-4f9d-adc7-1a9d3296825c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:07.973127 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977e56-f833-4f9d-adc7-1a9d3296825c None admin] PATH_INFO: `/v3/users/a751b52fcf40400e8553295a7aac987f` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:07.974328 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977e56-f833-4f9d-adc7-1a9d3296825c None admin] RBAC: Authorizing `identity:get_user(user_id=a751b52fcf40400e8553295a7aac987f)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:07.975803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977e56-f833-4f9d-adc7-1a9d3296825c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:07.977284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e536990-d16c-4b63-9aad-c9e92f692a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:07.977433 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 38/81] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/users/a751b52fcf40400e8553295a7aac987f => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:07.978284 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86977e56-f833-4f9d-adc7-1a9d3296825c None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-1e536990-d16c-4b63-9aad-c9e92f692a0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:07.985746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:07.986636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:07.987403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 44/82] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:07.988023 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e536990-d16c-4b63-9aad-c9e92f692a0c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:08.005212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:08.083025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86977e56-f833-4f9d-adc7-1a9d3296825c None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:08.089230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e536990-d16c-4b63-9aad-c9e92f692a0c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:08.113908 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:08.118941 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae958bc-74a7-484b-afe7-710ca6322aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:08.120389 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae958bc-74a7-484b-afe7-710ca6322aa1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:08.120676 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae958bc-74a7-484b-afe7-710ca6322aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:08.120952 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae958bc-74a7-484b-afe7-710ca6322aa1 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:08.122151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae958bc-74a7-484b-afe7-710ca6322aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:08.123641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae958bc-74a7-484b-afe7-710ca6322aa1 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:08.124400 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e919210-6965-451f-a217-71d864767ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:08.125051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919210-6965-451f-a217-71d864767ef1 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:08.125360 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 39/83] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:08.125467 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919210-6965-451f-a217-71d864767ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:08.125678 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919210-6965-451f-a217-71d864767ef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:08.126129 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae958bc-74a7-484b-afe7-710ca6322aa1 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:08.198787 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e919210-6965-451f-a217-71d864767ef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:08.200340 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e919210-6965-451f-a217-71d864767ef1 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:08.217338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:08.227102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae958bc-74a7-484b-afe7-710ca6322aa1 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:08.261975 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660b6d-96f8-47e2-af61-1eb7b14d74da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:08.262772 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660b6d-96f8-47e2-af61-1eb7b14d74da None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:08.263065 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660b6d-96f8-47e2-af61-1eb7b14d74da None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:08.263380 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660b6d-96f8-47e2-af61-1eb7b14d74da None admin] PATH_INFO: `/v3/domains/default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:08.264568 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75660b6d-96f8-47e2-af61-1eb7b14d74da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:08.266028 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75660b6d-96f8-47e2-af61-1eb7b14d74da None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:08.267691 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 40/84] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:08.268493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660b6d-96f8-47e2-af61-1eb7b14d74da None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:08.302375 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 45/85] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:08.303254 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e919210-6965-451f-a217-71d864767ef1 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:08.329436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:08.373232 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660b6d-96f8-47e2-af61-1eb7b14d74da None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:08.405130 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e919210-6965-451f-a217-71d864767ef1 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:08.407317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69edfe-eb01-4dac-b039-3c85d345b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:08.407964 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69edfe-eb01-4dac-b039-3c85d345b174 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:08.408251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69edfe-eb01-4dac-b039-3c85d345b174 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:08.408529 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69edfe-eb01-4dac-b039-3c85d345b174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:08.436375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:08.441295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4364cf0-4511-4c2a-a282-00d562a4f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:08.441961 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4364cf0-4511-4c2a-a282-00d562a4f522 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:08.442251 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4364cf0-4511-4c2a-a282-00d562a4f522 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:08.442535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4364cf0-4511-4c2a-a282-00d562a4f522 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:08.443315 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4364cf0-4511-4c2a-a282-00d562a4f522 None admin] RBAC: Adding query filter params (name=member) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:08.443630 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4364cf0-4511-4c2a-a282-00d562a4f522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:08.445032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4364cf0-4511-4c2a-a282-00d562a4f522 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:08.453595 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 46/86] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:08.454158 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4364cf0-4511-4c2a-a282-00d562a4f522 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:08.480873 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69edfe-eb01-4dac-b039-3c85d345b174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:08.482357 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69edfe-eb01-4dac-b039-3c85d345b174 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:08.547536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:08.562498 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4364cf0-4511-4c2a-a282-00d562a4f522 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:08.587311 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 41/87] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:08.588146 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69edfe-eb01-4dac-b039-3c85d345b174 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:08.598512 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65051914-ee27-464d-b87c-647b127df63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:08.599196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65051914-ee27-464d-b87c-647b127df63e None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:08.599486 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65051914-ee27-464d-b87c-647b127df63e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:08.599765 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65051914-ee27-464d-b87c-647b127df63e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:08.600595 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65051914-ee27-464d-b87c-647b127df63e None admin] RBAC: Adding query filter params (role.id=7bea6298af7e4980950949b024a1e103, scope.project.id=717b1694b0dd4e97b07cf61aeee56400, user.id=a751b52fcf40400e8553295a7aac987f) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:08.600910 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65051914-ee27-464d-b87c-647b127df63e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:08.602355 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65051914-ee27-464d-b87c-647b127df63e None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:08.608667 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 47/88] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:08 2022] GET /identity/v3/role_assignments?user.id=a751b52fcf40400e8553295a7aac987f&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=7bea6298af7e4980950949b024a1e103 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:08.609620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65051914-ee27-464d-b87c-647b127df63e None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:08.654858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:08.709216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69edfe-eb01-4dac-b039-3c85d345b174 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:08.727864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65051914-ee27-464d-b87c-647b127df63e None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:08.749276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7082d-0e97-4d6c-a071-2ca8e16257fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:08.749969 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7082d-0e97-4d6c-a071-2ca8e16257fd None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:08.750268 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7082d-0e97-4d6c-a071-2ca8e16257fd None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:08.750546 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7082d-0e97-4d6c-a071-2ca8e16257fd None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:08.751434 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7082d-0e97-4d6c-a071-2ca8e16257fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:08.752907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7082d-0e97-4d6c-a071-2ca8e16257fd None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:08.766467 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80a156-2ea4-4fd4-9c8a-2ac598444d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:08.767505 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a156-2ea4-4fd4-9c8a-2ac598444d73 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:08.767801 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a156-2ea4-4fd4-9c8a-2ac598444d73 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:08.768153 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a156-2ea4-4fd4-9c8a-2ac598444d73 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:08.770274 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80a156-2ea4-4fd4-9c8a-2ac598444d73 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:08.772944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80a156-2ea4-4fd4-9c8a-2ac598444d73 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:08.778242 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 48/89] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:08 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:08.778242 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80a156-2ea4-4fd4-9c8a-2ac598444d73 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:08.793859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 42/90] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:56:08 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:56:08.795793 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7082d-0e97-4d6c-a071-2ca8e16257fd None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:08.806394 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:08.913619 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80a156-2ea4-4fd4-9c8a-2ac598444d73 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:08.950838 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7082d-0e97-4d6c-a071-2ca8e16257fd None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:08.965294 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83930086-0f4d-4b31-a7b4-6b73115c90fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:08.966387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930086-0f4d-4b31-a7b4-6b73115c90fb None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:08.966682 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930086-0f4d-4b31-a7b4-6b73115c90fb None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:08.967253 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930086-0f4d-4b31-a7b4-6b73115c90fb None admin] PATH_INFO: `/v3/users/a751b52fcf40400e8553295a7aac987f` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:08.968794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:08.970539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83930086-0f4d-4b31-a7b4-6b73115c90fb None admin] RBAC: Authorizing `identity:get_user(user_id=a751b52fcf40400e8553295a7aac987f)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:08.973896 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83930086-0f4d-4b31-a7b4-6b73115c90fb None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:08.976175 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 49/91] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:08 2022] GET /identity/v3/users/a751b52fcf40400e8553295a7aac987f => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:08.976983 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83930086-0f4d-4b31-a7b4-6b73115c90fb None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:08.997671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a674aa-628b-4580-bfe2-4e4b3f1f1f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:08.998544 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a674aa-628b-4580-bfe2-4e4b3f1f1f1b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:08.999116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a674aa-628b-4580-bfe2-4e4b3f1f1f1b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:08.999116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a674aa-628b-4580-bfe2-4e4b3f1f1f1b None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:09.001291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a674aa-628b-4580-bfe2-4e4b3f1f1f1b None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:09.002783 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a674aa-628b-4580-bfe2-4e4b3f1f1f1b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:09.004809 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 43/92] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:08 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:09.005444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a674aa-628b-4580-bfe2-4e4b3f1f1f1b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:09.094539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:09.113564 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83930086-0f4d-4b31-a7b4-6b73115c90fb None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:09.126421 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a674aa-628b-4580-bfe2-4e4b3f1f1f1b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:09.156123 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415692d-7a7b-4193-a8d3-f2163ed76106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:09.156802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415692d-7a7b-4193-a8d3-f2163ed76106 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:09.157621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415692d-7a7b-4193-a8d3-f2163ed76106 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:09.157621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415692d-7a7b-4193-a8d3-f2163ed76106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:09.158352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415692d-7a7b-4193-a8d3-f2163ed76106 None admin] RBAC: Adding query filter params (role.id=472a286d91bd484a83e2de07fc231c06, scope.project.id=717b1694b0dd4e97b07cf61aeee56400, user.id=4a14840580b5465f8931c6040356529d) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:09.158676 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415692d-7a7b-4193-a8d3-f2163ed76106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:09.160184 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415692d-7a7b-4193-a8d3-f2163ed76106 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:09.168808 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 50/93] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:08 2022] GET /identity/v3/role_assignments?user.id=4a14840580b5465f8931c6040356529d&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=472a286d91bd484a83e2de07fc231c06 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:09.169427 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415692d-7a7b-4193-a8d3-f2163ed76106 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:09.169529 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34f35-8a7a-4d7a-ac94-ec5eba53c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:09.170505 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34f35-8a7a-4d7a-ac94-ec5eba53c50c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:09.170505 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34f35-8a7a-4d7a-ac94-ec5eba53c50c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:09.170659 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34f35-8a7a-4d7a-ac94-ec5eba53c50c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:09.238874 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:09.265282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c34f35-8a7a-4d7a-ac94-ec5eba53c50c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:09.267462 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c34f35-8a7a-4d7a-ac94-ec5eba53c50c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:09.320866 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415692d-7a7b-4193-a8d3-f2163ed76106 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:09.403000 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c3063-8ab4-4acc-be6b-b9660b448f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:09.404083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c3063-8ab4-4acc-be6b-b9660b448f80 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:09.404622 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c3063-8ab4-4acc-be6b-b9660b448f80 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:09.405104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c3063-8ab4-4acc-be6b-b9660b448f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:09.406242 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c3063-8ab4-4acc-be6b-b9660b448f80 None admin] RBAC: Adding query filter params (role.id=65e129db80a94ccfba2808ee5768976e, scope.project.id=717b1694b0dd4e97b07cf61aeee56400, user.id=a751b52fcf40400e8553295a7aac987f) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:09.406764 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c3063-8ab4-4acc-be6b-b9660b448f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:09.408656 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c3063-8ab4-4acc-be6b-b9660b448f80 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:09.420741 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 51/94] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:09 2022] GET /identity/v3/role_assignments?user.id=a751b52fcf40400e8553295a7aac987f&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=65e129db80a94ccfba2808ee5768976e => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:09.453350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 44/95] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:09.458582 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c3063-8ab4-4acc-be6b-b9660b448f80 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:09.495736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:09.631360 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c3063-8ab4-4acc-be6b-b9660b448f80 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:09.677203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c7da9-529d-4574-bdbf-5167deb3ed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:09.677203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c7da9-529d-4574-bdbf-5167deb3ed97 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:09.677203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c7da9-529d-4574-bdbf-5167deb3ed97 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:09.677203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c7da9-529d-4574-bdbf-5167deb3ed97 None admin] PATH_INFO: `/v3/projects/6ddb95693e344ac7bbb564d5056e6b7d` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:09.683974 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c7da9-529d-4574-bdbf-5167deb3ed97 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddb95693e344ac7bbb564d5056e6b7d)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:09.687687 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c7da9-529d-4574-bdbf-5167deb3ed97 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:09.687687 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 52/96] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:09 2022] GET /identity/v3/projects/6ddb95693e344ac7bbb564d5056e6b7d => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:09.694399 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34f35-8a7a-4d7a-ac94-ec5eba53c50c None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:09.814688 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:09.841675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34f35-8a7a-4d7a-ac94-ec5eba53c50c None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:09.881227 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93889236-10ae-4817-9bee-0cb29c2645b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:09.882278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889236-10ae-4817-9bee-0cb29c2645b1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:09.882782 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889236-10ae-4817-9bee-0cb29c2645b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:09.883548 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889236-10ae-4817-9bee-0cb29c2645b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:09.884604 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93889236-10ae-4817-9bee-0cb29c2645b1 None admin] RBAC: Adding query filter params (role.id=7bea6298af7e4980950949b024a1e103, scope.project.id=6ddb95693e344ac7bbb564d5056e6b7d, user.id=a751b52fcf40400e8553295a7aac987f) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:09.885661 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93889236-10ae-4817-9bee-0cb29c2645b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:09.887511 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93889236-10ae-4817-9bee-0cb29c2645b1 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:09.896534 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 45/97] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:09 2022] GET /identity/v3/role_assignments?user.id=a751b52fcf40400e8553295a7aac987f&scope.project.id=6ddb95693e344ac7bbb564d5056e6b7d&role.id=7bea6298af7e4980950949b024a1e103 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:12.039974 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593687e-3ada-4bed-9e32-bb366eed4ede None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.040514 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593687e-3ada-4bed-9e32-bb366eed4ede None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.040514 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593687e-3ada-4bed-9e32-bb366eed4ede None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.042573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 53/98] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:12.048093 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b546944-c931-4eaf-b804-53e67423ad3b None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.048521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b546944-c931-4eaf-b804-53e67423ad3b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.048714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b546944-c931-4eaf-b804-53e67423ad3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.072485 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-6b546944-c931-4eaf-b804-53e67423ad3b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:12.073683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-6b546944-c931-4eaf-b804-53e67423ad3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:12.173856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 46/99] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:12.213937 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593687e-3ada-4bed-9e32-bb366eed4ede None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:12.272150 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5d1f8-2b7f-40f9-8361-ac9a09c0e21b None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.272442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5d1f8-2b7f-40f9-8361-ac9a09c0e21b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.272706 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5d1f8-2b7f-40f9-8361-ac9a09c0e21b None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.274067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 47/100] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:12.281777 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332fcfd-e3c5-4721-8116-4036ba68881c None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.282058 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332fcfd-e3c5-4721-8116-4036ba68881c None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.282336 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332fcfd-e3c5-4721-8116-4036ba68881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.314459 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-c332fcfd-e3c5-4721-8116-4036ba68881c None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:12.315695 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-c332fcfd-e3c5-4721-8116-4036ba68881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:12.356309 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:12.375869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593687e-3ada-4bed-9e32-bb366eed4ede None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:12.407149 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 48/101] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:12.409692 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184152a-a336-4718-8891-7bc35958631d None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.410128 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184152a-a336-4718-8891-7bc35958631d None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.410562 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184152a-a336-4718-8891-7bc35958631d None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.412155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 49/102] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:12.413456 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98c12-49f7-4801-bad0-b9bfcb1fb820 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.413672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b42a3-0db5-422c-a4b2-588742e888f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:12.413897 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98c12-49f7-4801-bad0-b9bfcb1fb820 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.414316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98c12-49f7-4801-bad0-b9bfcb1fb820 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.414907 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b42a3-0db5-422c-a4b2-588742e888f3 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.415335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b42a3-0db5-422c-a4b2-588742e888f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.415715 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b42a3-0db5-422c-a4b2-588742e888f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.416199 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 50/103] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:12.417995 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976793c2-e346-42da-addc-78b336115289 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.418431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976793c2-e346-42da-addc-78b336115289 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.418861 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976793c2-e346-42da-addc-78b336115289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.429039 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b42a3-0db5-422c-a4b2-588742e888f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:12.433970 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-d10b42a3-0db5-422c-a4b2-588742e888f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:12.439447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:12.440506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:12.441299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:12.441894 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-976793c2-e346-42da-addc-78b336115289 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:12.442142 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-976793c2-e346-42da-addc-78b336115289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:12.443873 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 54/104] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:12.445323 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728cce8-9477-4e09-94b6-6e531869c35d None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.445835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728cce8-9477-4e09-94b6-6e531869c35d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.446314 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728cce8-9477-4e09-94b6-6e531869c35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.466116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-b728cce8-9477-4e09-94b6-6e531869c35d None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:12.467813 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-b728cce8-9477-4e09-94b6-6e531869c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:12.521025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 51/105] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:12.522513 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976793c2-e346-42da-addc-78b336115289 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:12.553472 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 55/106] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:12.554690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728cce8-9477-4e09-94b6-6e531869c35d None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:12.646260 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976793c2-e346-42da-addc-78b336115289 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:12.654210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:12.682475 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728cce8-9477-4e09-94b6-6e531869c35d None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:12.686315 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3fe91-d13c-41d3-a257-b6ca6b80358b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:12.687364 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3fe91-d13c-41d3-a257-b6ca6b80358b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.687907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3fe91-d13c-41d3-a257-b6ca6b80358b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.688400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3fe91-d13c-41d3-a257-b6ca6b80358b None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.689426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3fe91-d13c-41d3-a257-b6ca6b80358b None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:12.689969 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3fe91-d13c-41d3-a257-b6ca6b80358b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:12.691730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3fe91-d13c-41d3-a257-b6ca6b80358b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:12.695414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:12.704044 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 52/107] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:12.705335 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3fe91-d13c-41d3-a257-b6ca6b80358b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:12.723546 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766c264-1e8c-4b75-90be-6e378c08838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:12.724457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c264-1e8c-4b75-90be-6e378c08838f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.724749 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c264-1e8c-4b75-90be-6e378c08838f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.725065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c264-1e8c-4b75-90be-6e378c08838f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.726352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766c264-1e8c-4b75-90be-6e378c08838f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:12.727948 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766c264-1e8c-4b75-90be-6e378c08838f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:12.731069 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 56/108] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:12.732071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766c264-1e8c-4b75-90be-6e378c08838f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:12.819161 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3fe91-d13c-41d3-a257-b6ca6b80358b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:12.846678 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766c264-1e8c-4b75-90be-6e378c08838f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:12.862014 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca870a-da04-43fe-a99b-d02e85402b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:12.863386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca870a-da04-43fe-a99b-d02e85402b18 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.863866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca870a-da04-43fe-a99b-d02e85402b18 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.864342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca870a-da04-43fe-a99b-d02e85402b18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.876968 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca870a-da04-43fe-a99b-d02e85402b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-3aca870a-da04-43fe-a99b-d02e85402b18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:12.885734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:12.886619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:12.887420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:12.888581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 53/109] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:12.889738 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca870a-da04-43fe-a99b-d02e85402b18 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:12.896041 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e019c-5e75-4fc6-92d4-188215a8069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:12.897130 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e019c-5e75-4fc6-92d4-188215a8069e None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:12.897621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e019c-5e75-4fc6-92d4-188215a8069e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:12.898080 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e019c-5e75-4fc6-92d4-188215a8069e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:12.913136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e019c-5e75-4fc6-92d4-188215a8069e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-018e019c-5e75-4fc6-92d4-188215a8069e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:12.924680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:12.925549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:12.926325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:12.928985 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 57/110] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:56:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:12.933407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e019c-5e75-4fc6-92d4-188215a8069e None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:12.936753 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:12.960657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:13.008807 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca870a-da04-43fe-a99b-d02e85402b18 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:13.044473 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e019c-5e75-4fc6-92d4-188215a8069e None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:13.047651 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db50c4-34bb-438d-a77e-a859a07e2d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:13.048677 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db50c4-34bb-438d-a77e-a859a07e2d7f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.049159 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db50c4-34bb-438d-a77e-a859a07e2d7f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.049159 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db50c4-34bb-438d-a77e-a859a07e2d7f None admin] PATH_INFO: `/v3/users/a751b52fcf40400e8553295a7aac987f` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.050334 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db50c4-34bb-438d-a77e-a859a07e2d7f None admin] RBAC: Authorizing `identity:get_user(user_id=a751b52fcf40400e8553295a7aac987f)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:13.051992 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db50c4-34bb-438d-a77e-a859a07e2d7f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:13.053779 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 54/111] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:12 2022] GET /identity/v3/users/a751b52fcf40400e8553295a7aac987f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:13.055014 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d53104-a3d0-42ae-84bf-ae57c090c6cc None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.055323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d53104-a3d0-42ae-84bf-ae57c090c6cc None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.055662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d53104-a3d0-42ae-84bf-ae57c090c6cc None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.057391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 55/112] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:13.059282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d53104-a3d0-42ae-84bf-ae57c090c6cc None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:13.097669 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc26e6-fd44-4968-846b-8d1ad8eb6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:13.098384 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc26e6-fd44-4968-846b-8d1ad8eb6f43 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.098674 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc26e6-fd44-4968-846b-8d1ad8eb6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.099012 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc26e6-fd44-4968-846b-8d1ad8eb6f43 None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.099789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc26e6-fd44-4968-846b-8d1ad8eb6f43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:13.101685 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc26e6-fd44-4968-846b-8d1ad8eb6f43 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:13.134223 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 58/113] 10.222.0.98 () {60 vars in 1141 bytes} [Mon Jul 25 18:56:12 2022] POST /identity/v3/projects => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:56:13.135960 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc26e6-fd44-4968-846b-8d1ad8eb6f43 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:13.190299 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d53104-a3d0-42ae-84bf-ae57c090c6cc None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:13.227945 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:13.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:13.243105 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc199d4-1b4a-4749-9fb0-3dd953c8dc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:13.244040 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc199d4-1b4a-4749-9fb0-3dd953c8dc70 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.245204 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc199d4-1b4a-4749-9fb0-3dd953c8dc70 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.245919 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc199d4-1b4a-4749-9fb0-3dd953c8dc70 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.247611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc199d4-1b4a-4749-9fb0-3dd953c8dc70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:13.248100 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc199d4-1b4a-4749-9fb0-3dd953c8dc70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:13.249758 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc199d4-1b4a-4749-9fb0-3dd953c8dc70 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:13.261501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 56/114] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:13.262692 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc199d4-1b4a-4749-9fb0-3dd953c8dc70 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:13.291980 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc26e6-fd44-4968-846b-8d1ad8eb6f43 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:13.333354 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92223c99-f7fc-4165-a01d-f3820103a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:13.334250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92223c99-f7fc-4165-a01d-f3820103a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.334669 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92223c99-f7fc-4165-a01d-f3820103a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.335102 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92223c99-f7fc-4165-a01d-f3820103a8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.336056 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92223c99-f7fc-4165-a01d-f3820103a8b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:13.336586 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92223c99-f7fc-4165-a01d-f3820103a8b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:13.338997 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92223c99-f7fc-4165-a01d-f3820103a8b0 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:13.355104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 59/115] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:13.355104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0d91-cd57-4d04-b3b7-fae1432ca4d0 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.355104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0d91-cd57-4d04-b3b7-fae1432ca4d0 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.355104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0d91-cd57-4d04-b3b7-fae1432ca4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.375668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-00ca0d91-cd57-4d04-b3b7-fae1432ca4d0 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:13.376879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-00ca0d91-cd57-4d04-b3b7-fae1432ca4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:13.389146 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc199d4-1b4a-4749-9fb0-3dd953c8dc70 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:13.440972 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d603df-5316-45e5-a22e-9da99a26532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:13.441766 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d603df-5316-45e5-a22e-9da99a26532c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.442054 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d603df-5316-45e5-a22e-9da99a26532c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.442336 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d603df-5316-45e5-a22e-9da99a26532c None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.444537 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d603df-5316-45e5-a22e-9da99a26532c None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:13.445183 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d603df-5316-45e5-a22e-9da99a26532c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:13.447361 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 57/116] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:13 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:13.448327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d603df-5316-45e5-a22e-9da99a26532c None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:13.462596 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 60/117] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:13.464064 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca0d91-cd57-4d04-b3b7-fae1432ca4d0 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:13.509620 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:13.527496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:13.562226 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d603df-5316-45e5-a22e-9da99a26532c None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:13.583547 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca0d91-cd57-4d04-b3b7-fae1432ca4d0 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:13.602983 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b01df-5843-451e-9a5f-eea38fe2c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:13.603953 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b01df-5843-451e-9a5f-eea38fe2c82d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.604242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b01df-5843-451e-9a5f-eea38fe2c82d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.604615 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b01df-5843-451e-9a5f-eea38fe2c82d None admin] PATH_INFO: `/v3/users/dbb3f436eaec4b8b8d2873bf7765ded4` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.618200 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b01df-5843-451e-9a5f-eea38fe2c82d None admin] RBAC: Authorizing `identity:get_user(user_id=dbb3f436eaec4b8b8d2873bf7765ded4)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:13.619863 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b01df-5843-451e-9a5f-eea38fe2c82d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:13.623336 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 58/118] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:13 2022] GET /identity/v3/users/dbb3f436eaec4b8b8d2873bf7765ded4 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:13.623336 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b01df-5843-451e-9a5f-eea38fe2c82d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:13.628165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7094-0e75-4ab0-94e3-257f778ad3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:13.629245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7094-0e75-4ab0-94e3-257f778ad3e9 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.629538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7094-0e75-4ab0-94e3-257f778ad3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.629895 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7094-0e75-4ab0-94e3-257f778ad3e9 None admin] PATH_INFO: `/v3/users/4a14840580b5465f8931c6040356529d` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.631116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc7094-0e75-4ab0-94e3-257f778ad3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=4a14840580b5465f8931c6040356529d)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:13.632678 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc7094-0e75-4ab0-94e3-257f778ad3e9 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:13.635490 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 61/119] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:13 2022] GET /identity/v3/users/4a14840580b5465f8931c6040356529d => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:13.636397 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7094-0e75-4ab0-94e3-257f778ad3e9 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:13.737042 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b01df-5843-451e-9a5f-eea38fe2c82d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:13.752608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7094-0e75-4ab0-94e3-257f778ad3e9 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:13.753803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:13.768692 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:13.779313 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb0725-5e4b-439f-b85f-7863f7ebcfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:13.780516 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb0725-5e4b-439f-b85f-7863f7ebcfce None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.781037 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb0725-5e4b-439f-b85f-7863f7ebcfce None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.781389 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb0725-5e4b-439f-b85f-7863f7ebcfce None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400/users/a751b52fcf40400e8553295a7aac987f/roles/7bea6298af7e4980950949b024a1e103` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.783471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb0725-5e4b-439f-b85f-7863f7ebcfce None admin] RBAC: Authorizing `identity:create_grant(project_id=717b1694b0dd4e97b07cf61aeee56400, user_id=a751b52fcf40400e8553295a7aac987f, role_id=7bea6298af7e4980950949b024a1e103)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:13.784948 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb0725-5e4b-439f-b85f-7863f7ebcfce None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:13.793127 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dabc7-575f-4dd5-8159-a5f1cb9aa28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:13.794025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dabc7-575f-4dd5-8159-a5f1cb9aa28c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.794347 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dabc7-575f-4dd5-8159-a5f1cb9aa28c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.794635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dabc7-575f-4dd5-8159-a5f1cb9aa28c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.801191 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 59/120] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:56:13 2022] PUT /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400/users/a751b52fcf40400e8553295a7aac987f/roles/7bea6298af7e4980950949b024a1e103 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:13.802598 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97fbf-42e2-40f7-af97-9f45e3507c25 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:13.802902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97fbf-42e2-40f7-af97-9f45e3507c25 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:13.803221 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97fbf-42e2-40f7-af97-9f45e3507c25 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:13.804756 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 60/121] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:13.810510 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a97fbf-42e2-40f7-af97-9f45e3507c25 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:13.824817 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dabc7-575f-4dd5-8159-a5f1cb9aa28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-ac1dabc7-575f-4dd5-8159-a5f1cb9aa28c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:13.837389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:13.838902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:13.839792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:13.845812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 62/122] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:13.845812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dabc7-575f-4dd5-8159-a5f1cb9aa28c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:13.959275 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a97fbf-42e2-40f7-af97-9f45e3507c25 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:13.998223 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dabc7-575f-4dd5-8159-a5f1cb9aa28c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:14.002238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1049711-a872-45c4-bf42-e57e75466176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:14.002908 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1049711-a872-45c4-bf42-e57e75466176 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:14.003283 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1049711-a872-45c4-bf42-e57e75466176 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:14.003567 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1049711-a872-45c4-bf42-e57e75466176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:14.043968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69328b-3e71-4394-8652-670f651651d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:14.044605 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69328b-3e71-4394-8652-670f651651d2 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:14.045145 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69328b-3e71-4394-8652-670f651651d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:14.045145 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69328b-3e71-4394-8652-670f651651d2 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:14.051916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69328b-3e71-4394-8652-670f651651d2 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:14.053440 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69328b-3e71-4394-8652-670f651651d2 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:14.059185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 63/123] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:13 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:14.059185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9636f-326a-4e66-9b35-0ffe75ee8d32 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:14.059185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9636f-326a-4e66-9b35-0ffe75ee8d32 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:14.059185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9636f-326a-4e66-9b35-0ffe75ee8d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:14.069516 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:14.085291 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-2ae9636f-326a-4e66-9b35-0ffe75ee8d32 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:14.086450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-2ae9636f-326a-4e66-9b35-0ffe75ee8d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:14.110095 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1049711-a872-45c4-bf42-e57e75466176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:14.112612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1049711-a872-45c4-bf42-e57e75466176 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:14.155576 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:14.163327 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 64/124] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:14.171617 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9636f-326a-4e66-9b35-0ffe75ee8d32 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:14.243441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 61/125] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:14.248062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1049711-a872-45c4-bf42-e57e75466176 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:14.312688 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9636f-326a-4e66-9b35-0ffe75ee8d32 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:14.337143 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:14.349332 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96109f-d2b9-49c7-9dfe-b3f2f0d92d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:14.350041 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96109f-d2b9-49c7-9dfe-b3f2f0d92d18 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:14.350331 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96109f-d2b9-49c7-9dfe-b3f2f0d92d18 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:14.350615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96109f-d2b9-49c7-9dfe-b3f2f0d92d18 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:14.351404 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96109f-d2b9-49c7-9dfe-b3f2f0d92d18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:14.351717 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96109f-d2b9-49c7-9dfe-b3f2f0d92d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:14.353303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96109f-d2b9-49c7-9dfe-b3f2f0d92d18 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:14.362518 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 65/126] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:14.363512 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96109f-d2b9-49c7-9dfe-b3f2f0d92d18 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:14.373618 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1049711-a872-45c4-bf42-e57e75466176 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:14.401087 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:14.423450 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7c6e4-4847-4b6a-9acc-906bac956786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:14.425225 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7c6e4-4847-4b6a-9acc-906bac956786 None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:14.426003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7c6e4-4847-4b6a-9acc-906bac956786 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:14.426488 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7c6e4-4847-4b6a-9acc-906bac956786 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400/users/4a14840580b5465f8931c6040356529d/roles/472a286d91bd484a83e2de07fc231c06` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:14.429726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7c6e4-4847-4b6a-9acc-906bac956786 None admin] RBAC: Authorizing `identity:create_grant(project_id=717b1694b0dd4e97b07cf61aeee56400, user_id=4a14840580b5465f8931c6040356529d, role_id=472a286d91bd484a83e2de07fc231c06)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:14.433036 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7c6e4-4847-4b6a-9acc-906bac956786 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:14.459910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 62/127] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:56:14 2022] PUT /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400/users/4a14840580b5465f8931c6040356529d/roles/472a286d91bd484a83e2de07fc231c06 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:14.459910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7c6e4-4847-4b6a-9acc-906bac956786 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:14.510623 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96109f-d2b9-49c7-9dfe-b3f2f0d92d18 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:14.581547 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3998c4d-9c7b-48e1-a160-46b13a865eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:14.583349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3998c4d-9c7b-48e1-a160-46b13a865eff None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:14.583643 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3998c4d-9c7b-48e1-a160-46b13a865eff None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:14.583924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3998c4d-9c7b-48e1-a160-46b13a865eff None admin] PATH_INFO: `/v3/roles/member` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:14.608255 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3998c4d-9c7b-48e1-a160-46b13a865eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-a3998c4d-9c7b-48e1-a160-46b13a865eff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:14.619499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:14.620553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:14.621407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 66/128] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:14.623888 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3998c4d-9c7b-48e1-a160-46b13a865eff None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:14.665267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7c6e4-4847-4b6a-9acc-906bac956786 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:14.745455 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e030f0d-2a04-4f84-a552-f9027560b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:14.746968 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e030f0d-2a04-4f84-a552-f9027560b557 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:14.747482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e030f0d-2a04-4f84-a552-f9027560b557 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:14.748321 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e030f0d-2a04-4f84-a552-f9027560b557 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:14.750815 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e030f0d-2a04-4f84-a552-f9027560b557 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:14.752637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e030f0d-2a04-4f84-a552-f9027560b557 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:14.755104 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 63/129] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:14 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:14.756129 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e030f0d-2a04-4f84-a552-f9027560b557 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:14.761332 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:14.780440 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:14.788401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3998c4d-9c7b-48e1-a160-46b13a865eff None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:14.828377 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43abe72-b243-4742-b64e-5361aa0807fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:14.829305 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43abe72-b243-4742-b64e-5361aa0807fe None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:14.829540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43abe72-b243-4742-b64e-5361aa0807fe None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:14.829820 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43abe72-b243-4742-b64e-5361aa0807fe None admin] PATH_INFO: `/v3/users/a751b52fcf40400e8553295a7aac987f` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:14.831070 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43abe72-b243-4742-b64e-5361aa0807fe None admin] RBAC: Authorizing `identity:get_user(user_id=a751b52fcf40400e8553295a7aac987f)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:14.832551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43abe72-b243-4742-b64e-5361aa0807fe None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:14.834191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 67/130] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:14 2022] GET /identity/v3/users/a751b52fcf40400e8553295a7aac987f => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:14.834961 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43abe72-b243-4742-b64e-5361aa0807fe None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:14.908316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e030f0d-2a04-4f84-a552-f9027560b557 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:14.949100 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782250d-bd1a-442c-9bd5-3f04113e33df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:14.950202 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782250d-bd1a-442c-9bd5-3f04113e33df None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:14.950943 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782250d-bd1a-442c-9bd5-3f04113e33df None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:14.951455 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782250d-bd1a-442c-9bd5-3f04113e33df None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:14.952436 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782250d-bd1a-442c-9bd5-3f04113e33df None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:14.952950 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782250d-bd1a-442c-9bd5-3f04113e33df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:14.954658 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782250d-bd1a-442c-9bd5-3f04113e33df None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:14.965499 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 64/131] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:14.966756 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782250d-bd1a-442c-9bd5-3f04113e33df None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:15.042279 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43abe72-b243-4742-b64e-5361aa0807fe None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:15.046216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:15.083813 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782250d-bd1a-442c-9bd5-3f04113e33df None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:15.090203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861fc9d-7c4b-41b0-9ff6-dd3b6668728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:15.090882 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fc9d-7c4b-41b0-9ff6-dd3b6668728c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:15.091198 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fc9d-7c4b-41b0-9ff6-dd3b6668728c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:15.091485 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fc9d-7c4b-41b0-9ff6-dd3b6668728c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:15.092327 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861fc9d-7c4b-41b0-9ff6-dd3b6668728c None admin] RBAC: Adding query filter params (role.id=d1fa8990af404eefaf52fee0dc7d1811, scope.project.id=717b1694b0dd4e97b07cf61aeee56400, user.id=dbb3f436eaec4b8b8d2873bf7765ded4) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:15.092643 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861fc9d-7c4b-41b0-9ff6-dd3b6668728c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:15.094118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861fc9d-7c4b-41b0-9ff6-dd3b6668728c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:15.100665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 68/132] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:14 2022] GET /identity/v3/role_assignments?user.id=dbb3f436eaec4b8b8d2873bf7765ded4&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=d1fa8990af404eefaf52fee0dc7d1811 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:15.101517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861fc9d-7c4b-41b0-9ff6-dd3b6668728c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:15.128607 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddd61d-8685-439b-9562-a9c9f76c0b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:15.129832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddd61d-8685-439b-9562-a9c9f76c0b00 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:15.130326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddd61d-8685-439b-9562-a9c9f76c0b00 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:15.130930 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddd61d-8685-439b-9562-a9c9f76c0b00 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:15.132462 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddd61d-8685-439b-9562-a9c9f76c0b00 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:15.134204 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:15.135024 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddd61d-8685-439b-9562-a9c9f76c0b00 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:15.138105 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 65/133] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:14 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:15.144351 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddd61d-8685-439b-9562-a9c9f76c0b00 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:15.256205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861fc9d-7c4b-41b0-9ff6-dd3b6668728c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:15.325462 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e354bb-cb0a-4f86-85ab-fe9e949a6925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:15.326711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e354bb-cb0a-4f86-85ab-fe9e949a6925 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:15.327523 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e354bb-cb0a-4f86-85ab-fe9e949a6925 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:15.328036 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e354bb-cb0a-4f86-85ab-fe9e949a6925 None admin] PATH_INFO: `/v3/users/a751b52fcf40400e8553295a7aac987f` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:15.329772 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e354bb-cb0a-4f86-85ab-fe9e949a6925 None admin] RBAC: Authorizing `identity:get_user(user_id=a751b52fcf40400e8553295a7aac987f)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:15.331507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e354bb-cb0a-4f86-85ab-fe9e949a6925 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:15.333732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 69/134] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:15 2022] GET /identity/v3/users/a751b52fcf40400e8553295a7aac987f => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:15.344632 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e354bb-cb0a-4f86-85ab-fe9e949a6925 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:15.373970 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddd61d-8685-439b-9562-a9c9f76c0b00 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:15.448959 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:15.460754 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d90f5-5baf-4786-b638-18b51d5cd75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:15.461663 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d90f5-5baf-4786-b638-18b51d5cd75e None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:15.461953 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d90f5-5baf-4786-b638-18b51d5cd75e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:15.462233 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d90f5-5baf-4786-b638-18b51d5cd75e None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400/users/a751b52fcf40400e8553295a7aac987f/roles/65e129db80a94ccfba2808ee5768976e` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:15.468647 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d90f5-5baf-4786-b638-18b51d5cd75e None admin] RBAC: Authorizing `identity:create_grant(project_id=717b1694b0dd4e97b07cf61aeee56400, user_id=a751b52fcf40400e8553295a7aac987f, role_id=65e129db80a94ccfba2808ee5768976e)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:15.470137 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d90f5-5baf-4786-b638-18b51d5cd75e None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:15.506350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 66/135] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:56:15 2022] PUT /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400/users/a751b52fcf40400e8553295a7aac987f/roles/65e129db80a94ccfba2808ee5768976e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:15.516367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:15.522676 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e354bb-cb0a-4f86-85ab-fe9e949a6925 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:15.570661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73521ceb-d139-4103-a983-f156c5f04c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:15.571776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521ceb-d139-4103-a983-f156c5f04c69 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:15.572151 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521ceb-d139-4103-a983-f156c5f04c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:15.572486 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521ceb-d139-4103-a983-f156c5f04c69 None admin] PATH_INFO: `/v3/projects/6ddb95693e344ac7bbb564d5056e6b7d` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:15.576077 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73521ceb-d139-4103-a983-f156c5f04c69 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddb95693e344ac7bbb564d5056e6b7d)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:15.577525 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73521ceb-d139-4103-a983-f156c5f04c69 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:15.579294 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 70/136] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:15 2022] GET /identity/v3/projects/6ddb95693e344ac7bbb564d5056e6b7d => generated 312 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:15.585372 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d90f5-5baf-4786-b638-18b51d5cd75e None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:15.702717 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d90f5-5baf-4786-b638-18b51d5cd75e None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:15.750125 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8573ad-8634-4100-9a9d-50899378bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:15.751202 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8573ad-8634-4100-9a9d-50899378bd78 None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:15.751504 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8573ad-8634-4100-9a9d-50899378bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:15.751792 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8573ad-8634-4100-9a9d-50899378bd78 None admin] PATH_INFO: `/v3/projects/6ddb95693e344ac7bbb564d5056e6b7d/users/a751b52fcf40400e8553295a7aac987f/roles/7bea6298af7e4980950949b024a1e103` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:15.754132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8573ad-8634-4100-9a9d-50899378bd78 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ddb95693e344ac7bbb564d5056e6b7d, user_id=a751b52fcf40400e8553295a7aac987f, role_id=7bea6298af7e4980950949b024a1e103)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:15.755777 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8573ad-8634-4100-9a9d-50899378bd78 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:15.801778 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 67/137] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:56:15 2022] PUT /identity/v3/projects/6ddb95693e344ac7bbb564d5056e6b7d/users/a751b52fcf40400e8553295a7aac987f/roles/7bea6298af7e4980950949b024a1e103 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:16.021451 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba11330-5264-4654-b86e-7945ff3164c6 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:16.021777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba11330-5264-4654-b86e-7945ff3164c6 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:16.022125 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba11330-5264-4654-b86e-7945ff3164c6 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:16.023797 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 71/138] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:16.031219 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6cdde-7447-4781-a6dd-426cb42e4c6a None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:16.031521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6cdde-7447-4781-a6dd-426cb42e4c6a None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:16.031908 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6cdde-7447-4781-a6dd-426cb42e4c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:16.056100 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-1ec6cdde-7447-4781-a6dd-426cb42e4c6a None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:16.057504 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-1ec6cdde-7447-4781-a6dd-426cb42e4c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:16.122768 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:16.148484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 68/139] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:16.186881 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba11330-5264-4654-b86e-7945ff3164c6 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:16.302562 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba11330-5264-4654-b86e-7945ff3164c6 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:16.347235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5825a3-3f03-41ee-9b39-b4add11ab90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:16.348076 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5825a3-3f03-41ee-9b39-b4add11ab90f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:16.348365 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5825a3-3f03-41ee-9b39-b4add11ab90f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:16.348644 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5825a3-3f03-41ee-9b39-b4add11ab90f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:16.349912 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5825a3-3f03-41ee-9b39-b4add11ab90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:16.351449 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5825a3-3f03-41ee-9b39-b4add11ab90f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:16.353136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 72/140] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:16.358905 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6cdde-7447-4781-a6dd-426cb42e4c6a None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:16.499116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6cdde-7447-4781-a6dd-426cb42e4c6a None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:16.542923 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c0d79-066f-4423-a8c7-6788b186bbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:16.543641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c0d79-066f-4423-a8c7-6788b186bbc7 None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:16.543932 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c0d79-066f-4423-a8c7-6788b186bbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:16.544216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c0d79-066f-4423-a8c7-6788b186bbc7 None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:16.544940 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c0d79-066f-4423-a8c7-6788b186bbc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:16.546402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c0d79-066f-4423-a8c7-6788b186bbc7 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:16.582010 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 69/141] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:56:16 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:56:16.617081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da9aaf-4c20-443e-a871-c06faeb250f1 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:16.617381 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da9aaf-4c20-443e-a871-c06faeb250f1 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:16.617752 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da9aaf-4c20-443e-a871-c06faeb250f1 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:16.619324 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 73/142] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:16.625363 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f2235-8105-46d2-94ce-414b19082847 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:16.625974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f2235-8105-46d2-94ce-414b19082847 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:16.626448 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f2235-8105-46d2-94ce-414b19082847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:16.656270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-c94f2235-8105-46d2-94ce-414b19082847 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:16.657595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-c94f2235-8105-46d2-94ce-414b19082847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:16.704141 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:16.768920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 70/143] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:16.809237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da9aaf-4c20-443e-a871-c06faeb250f1 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:16.854930 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:16.951798 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da9aaf-4c20-443e-a871-c06faeb250f1 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:16.992524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbde2b-245a-459b-b3b7-0b0051db5638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:16.993324 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbde2b-245a-459b-b3b7-0b0051db5638 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:16.993604 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbde2b-245a-459b-b3b7-0b0051db5638 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:16.993876 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbde2b-245a-459b-b3b7-0b0051db5638 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:17.004584 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbde2b-245a-459b-b3b7-0b0051db5638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-bccbde2b-245a-459b-b3b7-0b0051db5638 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:17.013098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:17.013944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:17.014791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 74/144] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:17.021652 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f2235-8105-46d2-94ce-414b19082847 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:17.181380 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f2235-8105-46d2-94ce-414b19082847 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:17.229037 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892db5c8-0cd0-4269-95c6-4109a155662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:17.229896 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892db5c8-0cd0-4269-95c6-4109a155662b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:17.230190 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892db5c8-0cd0-4269-95c6-4109a155662b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:17.230470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892db5c8-0cd0-4269-95c6-4109a155662b None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:17.231256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892db5c8-0cd0-4269-95c6-4109a155662b None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:17.231572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892db5c8-0cd0-4269-95c6-4109a155662b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:17.232966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892db5c8-0cd0-4269-95c6-4109a155662b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:17.247672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 71/145] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:17.253364 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbde2b-245a-459b-b3b7-0b0051db5638 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:17.387776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:17.399161 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbde2b-245a-459b-b3b7-0b0051db5638 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:17.438860 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49f540-1cac-4dd4-9b51-9d40ead63316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:17.439685 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49f540-1cac-4dd4-9b51-9d40ead63316 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:17.439969 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49f540-1cac-4dd4-9b51-9d40ead63316 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:17.440245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49f540-1cac-4dd4-9b51-9d40ead63316 None admin] PATH_INFO: `/v3/users/a751b52fcf40400e8553295a7aac987f` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:17.443843 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49f540-1cac-4dd4-9b51-9d40ead63316 None admin] RBAC: Authorizing `identity:get_user(user_id=a751b52fcf40400e8553295a7aac987f)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:17.445329 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49f540-1cac-4dd4-9b51-9d40ead63316 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:17.447155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 75/146] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:17 2022] GET /identity/v3/users/a751b52fcf40400e8553295a7aac987f => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:17.453594 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892db5c8-0cd0-4269-95c6-4109a155662b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:17.489326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:17.570986 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892db5c8-0cd0-4269-95c6-4109a155662b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:17.614649 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc47d1-3b3d-4086-a97e-cc34de381660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:17.615327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc47d1-3b3d-4086-a97e-cc34de381660 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:17.615612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc47d1-3b3d-4086-a97e-cc34de381660 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:17.615946 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc47d1-3b3d-4086-a97e-cc34de381660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:17.699731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc47d1-3b3d-4086-a97e-cc34de381660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:17.701209 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc47d1-3b3d-4086-a97e-cc34de381660 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:17.736881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:17.844196 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 72/147] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:17.850677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49f540-1cac-4dd4-9b51-9d40ead63316 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:17.988078 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c95c6c-c748-49db-a58f-960b315f4018 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:17.988390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c95c6c-c748-49db-a58f-960b315f4018 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:17.988555 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c95c6c-c748-49db-a58f-960b315f4018 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:17.989910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 73/148] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:56:17.995612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cafd88-f78c-4b6b-9df0-72823d249db7 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:17.995896 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cafd88-f78c-4b6b-9df0-72823d249db7 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:17.996174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cafd88-f78c-4b6b-9df0-72823d249db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:18.014998 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49f540-1cac-4dd4-9b51-9d40ead63316 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:18.046727 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-27cafd88-f78c-4b6b-9df0-72823d249db7 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:18.047956 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-27cafd88-f78c-4b6b-9df0-72823d249db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:18.062245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13953-8a4e-4f42-a7a1-55e130dbfb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:18.063145 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13953-8a4e-4f42-a7a1-55e130dbfb7c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:18.063437 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13953-8a4e-4f42-a7a1-55e130dbfb7c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:18.063717 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13953-8a4e-4f42-a7a1-55e130dbfb7c None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:18.067962 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f13953-8a4e-4f42-a7a1-55e130dbfb7c None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:18.069472 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f13953-8a4e-4f42-a7a1-55e130dbfb7c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:18.071568 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 76/149] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:17 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:18.079032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13953-8a4e-4f42-a7a1-55e130dbfb7c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:18.148750 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:18.177603 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 74/150] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:56:18.272251 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13953-8a4e-4f42-a7a1-55e130dbfb7c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:18.277037 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cafd88-f78c-4b6b-9df0-72823d249db7 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:18.318664 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b876b2-b5ff-4437-a123-ec246ff991bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:18.319362 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b876b2-b5ff-4437-a123-ec246ff991bb None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:18.319655 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b876b2-b5ff-4437-a123-ec246ff991bb None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:18.320003 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b876b2-b5ff-4437-a123-ec246ff991bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:18.320852 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b876b2-b5ff-4437-a123-ec246ff991bb None admin] RBAC: Adding query filter params (role.id=7bea6298af7e4980950949b024a1e103, scope.project.id=717b1694b0dd4e97b07cf61aeee56400, user.id=a751b52fcf40400e8553295a7aac987f) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:18.321167 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b876b2-b5ff-4437-a123-ec246ff991bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:18.323227 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b876b2-b5ff-4437-a123-ec246ff991bb None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:18.334154 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 77/151] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:18 2022] GET /identity/v3/role_assignments?user.id=a751b52fcf40400e8553295a7aac987f&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=7bea6298af7e4980950949b024a1e103 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:18.374372 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:18.430127 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cafd88-f78c-4b6b-9df0-72823d249db7 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:18.478674 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc2535-f302-4e10-9c34-af037b646a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:18.479902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc2535-f302-4e10-9c34-af037b646a73 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:18.480394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc2535-f302-4e10-9c34-af037b646a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:18.480870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc2535-f302-4e10-9c34-af037b646a73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:18.496272 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc2535-f302-4e10-9c34-af037b646a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-a5fc2535-f302-4e10-9c34-af037b646a73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:18.504484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:18.505342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:18.506085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:18.512965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 75/152] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:56:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:56:18.524504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b876b2-b5ff-4437-a123-ec246ff991bb None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:18.642743 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:18.657362 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b876b2-b5ff-4437-a123-ec246ff991bb None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:18.702748 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11253703-aef0-4d02-b496-0d5baa413330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:18.703457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11253703-aef0-4d02-b496-0d5baa413330 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:18.703746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11253703-aef0-4d02-b496-0d5baa413330 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:18.704023 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11253703-aef0-4d02-b496-0d5baa413330 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:18.704785 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11253703-aef0-4d02-b496-0d5baa413330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:18.705100 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11253703-aef0-4d02-b496-0d5baa413330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:18.706583 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11253703-aef0-4d02-b496-0d5baa413330 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:18.716002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 78/153] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:18.721908 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc2535-f302-4e10-9c34-af037b646a73 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:18.725314 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5dba2-1b9d-4799-a0b1-c0b9bdea8046 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:18.725612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5dba2-1b9d-4799-a0b1-c0b9bdea8046 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:18.725897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5dba2-1b9d-4799-a0b1-c0b9bdea8046 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:18.727304 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 79/154] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:56:18.745401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d1c3-8707-43e5-a072-0dd7bb24b673 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:18.745737 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d1c3-8707-43e5-a072-0dd7bb24b673 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:18.745961 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d1c3-8707-43e5-a072-0dd7bb24b673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:18.772232 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-0402d1c3-8707-43e5-a072-0dd7bb24b673 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:18.773465 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-0402d1c3-8707-43e5-a072-0dd7bb24b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:18.846495 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc2535-f302-4e10-9c34-af037b646a73 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:18.870920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:18.872461 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 80/155] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:56:18.902931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0139d-4279-405b-80f2-ab178d8449ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:18.904208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0139d-4279-405b-80f2-ab178d8449ed None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:18.904692 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0139d-4279-405b-80f2-ab178d8449ed None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:18.905249 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0139d-4279-405b-80f2-ab178d8449ed None admin] PATH_INFO: `/v3/users/4a14840580b5465f8931c6040356529d` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:18.911897 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0139d-4279-405b-80f2-ab178d8449ed None admin] RBAC: Authorizing `identity:get_user(user_id=4a14840580b5465f8931c6040356529d)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:18.913618 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0139d-4279-405b-80f2-ab178d8449ed None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:18.915565 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 76/156] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:18 2022] GET /identity/v3/users/4a14840580b5465f8931c6040356529d => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:18.921876 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402d1c3-8707-43e5-a072-0dd7bb24b673 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:18.930770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0139d-4279-405b-80f2-ab178d8449ed None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:19.016122 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:19.035538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402d1c3-8707-43e5-a072-0dd7bb24b673 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:19.074941 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0139d-4279-405b-80f2-ab178d8449ed None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:19.075275 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d815c-3bc8-4832-b4db-4eed9dd2ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:19.075695 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d815c-3bc8-4832-b4db-4eed9dd2ef81 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:19.075983 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d815c-3bc8-4832-b4db-4eed9dd2ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:19.076263 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d815c-3bc8-4832-b4db-4eed9dd2ef81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:19.139844 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6abf50-668e-457f-885d-f633d1e671d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:19.140571 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abf50-668e-457f-885d-f633d1e671d2 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:19.140859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abf50-668e-457f-885d-f633d1e671d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:19.141147 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abf50-668e-457f-885d-f633d1e671d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:19.165150 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6abf50-668e-457f-885d-f633d1e671d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-0d6abf50-668e-457f-885d-f633d1e671d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:19.174066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:19.175041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:19.175867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:19.182979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d815c-3bc8-4832-b4db-4eed9dd2ef81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:19.184526 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d815c-3bc8-4832-b4db-4eed9dd2ef81 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:19.186598 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 77/157] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:56:19.192626 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6abf50-668e-457f-885d-f633d1e671d2 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:19.292424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:19.299072 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:19.312622 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 81/158] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:19.318437 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d815c-3bc8-4832-b4db-4eed9dd2ef81 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:19.413227 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6abf50-668e-457f-885d-f633d1e671d2 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:19.444853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d815c-3bc8-4832-b4db-4eed9dd2ef81 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:19.481026 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950130b6-8343-40b6-8961-91be32c4be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:19.481706 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950130b6-8343-40b6-8961-91be32c4be4d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:19.481991 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950130b6-8343-40b6-8961-91be32c4be4d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:19.482268 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950130b6-8343-40b6-8961-91be32c4be4d None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:19.483022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950130b6-8343-40b6-8961-91be32c4be4d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:19.483347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950130b6-8343-40b6-8961-91be32c4be4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:19.484732 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950130b6-8343-40b6-8961-91be32c4be4d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:19.489987 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6e56f-aef9-4ef3-9b0b-371d03e73473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:19.490857 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6e56f-aef9-4ef3-9b0b-371d03e73473 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:19.491152 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6e56f-aef9-4ef3-9b0b-371d03e73473 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:19.491439 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6e56f-aef9-4ef3-9b0b-371d03e73473 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:19.492643 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6e56f-aef9-4ef3-9b0b-371d03e73473 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:19.494168 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6e56f-aef9-4ef3-9b0b-371d03e73473 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:19.496429 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 82/159] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:19 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:19.502211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6e56f-aef9-4ef3-9b0b-371d03e73473 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:19.503537 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 78/160] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:19.509175 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950130b6-8343-40b6-8961-91be32c4be4d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:19.559497 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:19.610078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6e56f-aef9-4ef3-9b0b-371d03e73473 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:19.645178 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49ed5-ef62-4442-ad85-aa57e7957824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:19.645839 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49ed5-ef62-4442-ad85-aa57e7957824 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:19.646125 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49ed5-ef62-4442-ad85-aa57e7957824 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:19.646410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49ed5-ef62-4442-ad85-aa57e7957824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:19.647267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49ed5-ef62-4442-ad85-aa57e7957824 None admin] RBAC: Adding query filter params (role.id=472a286d91bd484a83e2de07fc231c06, scope.project.id=717b1694b0dd4e97b07cf61aeee56400, user.id=4a14840580b5465f8931c6040356529d) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:19.647586 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49ed5-ef62-4442-ad85-aa57e7957824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:19.649083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49ed5-ef62-4442-ad85-aa57e7957824 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:19.656197 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 83/161] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:19 2022] GET /identity/v3/role_assignments?user.id=4a14840580b5465f8931c6040356529d&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=472a286d91bd484a83e2de07fc231c06 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:19.737066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950130b6-8343-40b6-8961-91be32c4be4d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:19.765104 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:19.793465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05e08d-7f52-42c6-a3f4-7b65b3be7e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:19.794375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05e08d-7f52-42c6-a3f4-7b65b3be7e29 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:19.794659 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05e08d-7f52-42c6-a3f4-7b65b3be7e29 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:19.794935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05e08d-7f52-42c6-a3f4-7b65b3be7e29 None admin] PATH_INFO: `/v3/users/dbb3f436eaec4b8b8d2873bf7765ded4` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:19.796213 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05e08d-7f52-42c6-a3f4-7b65b3be7e29 None admin] RBAC: Authorizing `identity:get_user(user_id=dbb3f436eaec4b8b8d2873bf7765ded4)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:19.797681 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05e08d-7f52-42c6-a3f4-7b65b3be7e29 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:19.803741 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 79/162] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:19 2022] GET /identity/v3/users/dbb3f436eaec4b8b8d2873bf7765ded4 => generated 289 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:19.810072 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49ed5-ef62-4442-ad85-aa57e7957824 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:19.934458 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49ed5-ef62-4442-ad85-aa57e7957824 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:19.951070 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:19.974243 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77b559-14b4-429e-bfac-bea535c830bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:19.975265 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77b559-14b4-429e-bfac-bea535c830bc None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:19.975620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77b559-14b4-429e-bfac-bea535c830bc None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:19.975970 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77b559-14b4-429e-bfac-bea535c830bc None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:19.977369 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77b559-14b4-429e-bfac-bea535c830bc None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:19.979517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77b559-14b4-429e-bfac-bea535c830bc None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:19.981270 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 84/163] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:19 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:19.987086 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05e08d-7f52-42c6-a3f4-7b65b3be7e29 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:20.142769 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05e08d-7f52-42c6-a3f4-7b65b3be7e29 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:20.147199 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f32717-3a2b-4ddb-8bda-06ee7ad98a11 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:20.147497 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f32717-3a2b-4ddb-8bda-06ee7ad98a11 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:20.147779 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f32717-3a2b-4ddb-8bda-06ee7ad98a11 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:20.149327 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 85/164] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:20.162725 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fef3e9-c128-4817-8e24-b0b8ee472d07 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:20.163007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fef3e9-c128-4817-8e24-b0b8ee472d07 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:20.163320 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fef3e9-c128-4817-8e24-b0b8ee472d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:20.193698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-35fef3e9-c128-4817-8e24-b0b8ee472d07 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:20.194952 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-35fef3e9-c128-4817-8e24-b0b8ee472d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:20.225620 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff889005-c062-45e1-b198-1e53e2cd0ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:20.226456 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff889005-c062-45e1-b198-1e53e2cd0ed3 None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:20.226745 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff889005-c062-45e1-b198-1e53e2cd0ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:20.227024 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff889005-c062-45e1-b198-1e53e2cd0ed3 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400/users/dbb3f436eaec4b8b8d2873bf7765ded4/roles/d1fa8990af404eefaf52fee0dc7d1811` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:20.230697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff889005-c062-45e1-b198-1e53e2cd0ed3 None admin] RBAC: Authorizing `identity:create_grant(project_id=717b1694b0dd4e97b07cf61aeee56400, user_id=dbb3f436eaec4b8b8d2873bf7765ded4, role_id=d1fa8990af404eefaf52fee0dc7d1811)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:20.232189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff889005-c062-45e1-b198-1e53e2cd0ed3 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:20.253941 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 80/165] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:56:19 2022] PUT /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400/users/dbb3f436eaec4b8b8d2873bf7765ded4/roles/d1fa8990af404eefaf52fee0dc7d1811 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:20.292496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2187e56-f5fa-4ee8-a3a9-02e98038a2bd None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:20.292861 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2187e56-f5fa-4ee8-a3a9-02e98038a2bd None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:20.293060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2187e56-f5fa-4ee8-a3a9-02e98038a2bd None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:20.294692 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 81/166] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:56:20.303253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df720968-0d27-41b9-90b9-bffad8ab9055 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:20.303845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df720968-0d27-41b9-90b9-bffad8ab9055 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:20.303915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df720968-0d27-41b9-90b9-bffad8ab9055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:20.335858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-df720968-0d27-41b9-90b9-bffad8ab9055 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:20.338713 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 86/167] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:20.339285 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-df720968-0d27-41b9-90b9-bffad8ab9055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:20.378643 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:20.386559 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fef3e9-c128-4817-8e24-b0b8ee472d07 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:20.454174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 82/168] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:20.499343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df720968-0d27-41b9-90b9-bffad8ab9055 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:20.580990 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fef3e9-c128-4817-8e24-b0b8ee472d07 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:20.610645 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:20.688193 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388cd72-9659-42df-880c-ecc3ea593c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:20.689039 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388cd72-9659-42df-880c-ecc3ea593c36 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:20.689332 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388cd72-9659-42df-880c-ecc3ea593c36 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:20.689620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388cd72-9659-42df-880c-ecc3ea593c36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:20.690375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df720968-0d27-41b9-90b9-bffad8ab9055 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:20.731171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f722fb-f24d-4657-9d85-dcd62fedecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:20.731976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f722fb-f24d-4657-9d85-dcd62fedecf8 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:20.732260 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f722fb-f24d-4657-9d85-dcd62fedecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:20.732536 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f722fb-f24d-4657-9d85-dcd62fedecf8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:20.734207 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388cd72-9659-42df-880c-ecc3ea593c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:20.743310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f722fb-f24d-4657-9d85-dcd62fedecf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-0388cd72-9659-42df-880c-ecc3ea593c36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:20.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:20.749459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:20.750245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 87/169] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-05f722fb-f24d-4657-9d85-dcd62fedecf8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:20.752705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:20.753909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:20.754767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 83/170] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:56:20.766049 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f722fb-f24d-4657-9d85-dcd62fedecf8 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:20.766288 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388cd72-9659-42df-880c-ecc3ea593c36 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:20.810002 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:20.924803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f722fb-f24d-4657-9d85-dcd62fedecf8 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:20.982423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddc8e2-a63e-4778-b453-90f86d5f400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:20.983103 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddc8e2-a63e-4778-b453-90f86d5f400d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:20.983420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddc8e2-a63e-4778-b453-90f86d5f400d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:20.983697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddc8e2-a63e-4778-b453-90f86d5f400d None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:20.984459 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddc8e2-a63e-4778-b453-90f86d5f400d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:20.984766 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddc8e2-a63e-4778-b453-90f86d5f400d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:20.986162 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddc8e2-a63e-4778-b453-90f86d5f400d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:20.995288 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 84/171] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:21.001168 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddc8e2-a63e-4778-b453-90f86d5f400d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:21.022432 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388cd72-9659-42df-880c-ecc3ea593c36 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:21.059069 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75d3a-959c-45a3-9933-54fe66492cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:21.059879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75d3a-959c-45a3-9933-54fe66492cc4 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:21.060159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75d3a-959c-45a3-9933-54fe66492cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:21.060443 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75d3a-959c-45a3-9933-54fe66492cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:21.061203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea75d3a-959c-45a3-9933-54fe66492cc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:21.061518 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea75d3a-959c-45a3-9933-54fe66492cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:21.062919 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea75d3a-959c-45a3-9933-54fe66492cc4 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:21.071967 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 88/172] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:21.083176 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75d3a-959c-45a3-9933-54fe66492cc4 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:21.147501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:21.162380 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddc8e2-a63e-4778-b453-90f86d5f400d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:21.178357 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:21.209021 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26b957-0225-4892-bd6d-4d82b8f3df52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:21.209944 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26b957-0225-4892-bd6d-4d82b8f3df52 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:21.210236 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26b957-0225-4892-bd6d-4d82b8f3df52 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:21.210517 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26b957-0225-4892-bd6d-4d82b8f3df52 None admin] PATH_INFO: `/v3/users/a751b52fcf40400e8553295a7aac987f` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:21.211864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26b957-0225-4892-bd6d-4d82b8f3df52 None admin] RBAC: Authorizing `identity:get_user(user_id=a751b52fcf40400e8553295a7aac987f)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:21.214049 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26b957-0225-4892-bd6d-4d82b8f3df52 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:21.215868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 85/173] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:21 2022] GET /identity/v3/users/a751b52fcf40400e8553295a7aac987f => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:21.224204 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26b957-0225-4892-bd6d-4d82b8f3df52 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:21.329699 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75d3a-959c-45a3-9933-54fe66492cc4 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:21.388455 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76f049-634d-462a-bfc5-8ca5afb77d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:21.389352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76f049-634d-462a-bfc5-8ca5afb77d3b None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:21.389638 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76f049-634d-462a-bfc5-8ca5afb77d3b None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:21.389916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76f049-634d-462a-bfc5-8ca5afb77d3b None admin] PATH_INFO: `/v3/users/a751b52fcf40400e8553295a7aac987f` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:21.395897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76f049-634d-462a-bfc5-8ca5afb77d3b None admin] RBAC: Authorizing `identity:get_user(user_id=a751b52fcf40400e8553295a7aac987f)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:21.397417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76f049-634d-462a-bfc5-8ca5afb77d3b None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:21.399118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 89/174] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:21 2022] GET /identity/v3/users/a751b52fcf40400e8553295a7aac987f => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:21.409330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76f049-634d-462a-bfc5-8ca5afb77d3b None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:21.429909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26b957-0225-4892-bd6d-4d82b8f3df52 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:21.482908 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655f847-a0df-445b-a533-d4f055e459de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:21.484001 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655f847-a0df-445b-a533-d4f055e459de None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:21.484538 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655f847-a0df-445b-a533-d4f055e459de None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:21.485043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655f847-a0df-445b-a533-d4f055e459de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:21.537590 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:21.601884 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76f049-634d-462a-bfc5-8ca5afb77d3b None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:21.618472 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655f847-a0df-445b-a533-d4f055e459de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:21.620126 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655f847-a0df-445b-a533-d4f055e459de None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:21.622364 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:21.668970 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000f150-5549-4f1f-933e-14391a32dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:21.669631 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000f150-5549-4f1f-933e-14391a32dc9d None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:21.669923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000f150-5549-4f1f-933e-14391a32dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:21.670203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000f150-5549-4f1f-933e-14391a32dc9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:21.815157 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000f150-5549-4f1f-933e-14391a32dc9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:21.816680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000f150-5549-4f1f-933e-14391a32dc9d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:21.834482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 86/175] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:21.835950 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73beab8-e1b5-4ebc-a790-03f06a61204d None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:21.836242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73beab8-e1b5-4ebc-a790-03f06a61204d None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:21.836529 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73beab8-e1b5-4ebc-a790-03f06a61204d None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:21.837788 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 87/176] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:21.844087 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73beab8-e1b5-4ebc-a790-03f06a61204d None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:21.951642 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:21.990022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 90/177] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 18:56:21.991158 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e2e3-8df9-4cde-946b-351fc7998344 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:21.991539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e2e3-8df9-4cde-946b-351fc7998344 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:21.991816 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e2e3-8df9-4cde-946b-351fc7998344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:21.998878 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:22.012635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-7348e2e3-8df9-4cde-946b-351fc7998344 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:22.014515 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-7348e2e3-8df9-4cde-946b-351fc7998344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:22.022988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73beab8-e1b5-4ebc-a790-03f06a61204d None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:22.065534 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af849845-270b-47dc-93a0-d61879e08a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:22.070212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af849845-270b-47dc-93a0-d61879e08a0e None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.070755 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af849845-270b-47dc-93a0-d61879e08a0e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.071069 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af849845-270b-47dc-93a0-d61879e08a0e None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.073198 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af849845-270b-47dc-93a0-d61879e08a0e None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:22.075185 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af849845-270b-47dc-93a0-d61879e08a0e None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:22.083446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 88/178] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:21 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:22.083446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149212b6-68ce-44fb-bf6c-706b06bcb933 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.083446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149212b6-68ce-44fb-bf6c-706b06bcb933 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.083446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149212b6-68ce-44fb-bf6c-706b06bcb933 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.083446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 89/179] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:22.083446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149212b6-68ce-44fb-bf6c-706b06bcb933 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:22.103116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 91/180] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:22.104497 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e4112-e4f8-47d7-8fca-0d5e2c0ce321 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.104792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e4112-e4f8-47d7-8fca-0d5e2c0ce321 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.105076 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e4112-e4f8-47d7-8fca-0d5e2c0ce321 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.106470 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 92/181] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:22.111184 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e4112-e4f8-47d7-8fca-0d5e2c0ce321 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:22.200753 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149212b6-68ce-44fb-bf6c-706b06bcb933 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:22.227884 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e4112-e4f8-47d7-8fca-0d5e2c0ce321 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:22.228053 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:22.238552 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2ee38-a421-44b1-b831-23d257292342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:22.239447 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2ee38-a421-44b1-b831-23d257292342 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.239735 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2ee38-a421-44b1-b831-23d257292342 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.240013 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2ee38-a421-44b1-b831-23d257292342 None admin] PATH_INFO: `/v3/projects/6ddb95693e344ac7bbb564d5056e6b7d` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.241380 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2ee38-a421-44b1-b831-23d257292342 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddb95693e344ac7bbb564d5056e6b7d)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:22.242835 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2ee38-a421-44b1-b831-23d257292342 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:22.249935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 90/182] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:22 2022] GET /identity/v3/projects/6ddb95693e344ac7bbb564d5056e6b7d => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:22.249935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e2f9-40d7-4d6d-98be-bc85773547ea None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.249935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e2f9-40d7-4d6d-98be-bc85773547ea None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.249935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e2f9-40d7-4d6d-98be-bc85773547ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.266929 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:22.268323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-d498e2f9-40d7-4d6d-98be-bc85773547ea None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:22.270100 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-d498e2f9-40d7-4d6d-98be-bc85773547ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:22.272479 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06d7cd-b67e-412a-8508-5634e7529c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:22.273137 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06d7cd-b67e-412a-8508-5634e7529c04 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.273427 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06d7cd-b67e-412a-8508-5634e7529c04 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.273706 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06d7cd-b67e-412a-8508-5634e7529c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.274541 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06d7cd-b67e-412a-8508-5634e7529c04 None admin] RBAC: Adding query filter params (role.id=65e129db80a94ccfba2808ee5768976e, scope.project.id=717b1694b0dd4e97b07cf61aeee56400, user.id=a751b52fcf40400e8553295a7aac987f) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:22.274860 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06d7cd-b67e-412a-8508-5634e7529c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:22.277037 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06d7cd-b67e-412a-8508-5634e7529c04 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:22.283233 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 93/183] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:22 2022] GET /identity/v3/role_assignments?user.id=a751b52fcf40400e8553295a7aac987f&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=65e129db80a94ccfba2808ee5768976e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:22.284547 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100be40-5a6f-4216-b046-690c4f978df6 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.284844 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100be40-5a6f-4216-b046-690c4f978df6 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.285125 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100be40-5a6f-4216-b046-690c4f978df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.308914 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-5100be40-5a6f-4216-b046-690c4f978df6 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:22.310393 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-5100be40-5a6f-4216-b046-690c4f978df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:22.358888 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 91/184] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:22.359679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e2f9-40d7-4d6d-98be-bc85773547ea None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:22.393940 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 94/185] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:22.395499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100be40-5a6f-4216-b046-690c4f978df6 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:22.493931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e2f9-40d7-4d6d-98be-bc85773547ea None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:22.528384 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:22.542547 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480ba73-7c77-4480-9387-003aff6efd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:22.544277 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ba73-7c77-4480-9387-003aff6efd13 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.544277 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ba73-7c77-4480-9387-003aff6efd13 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.544277 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ba73-7c77-4480-9387-003aff6efd13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.559335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100be40-5a6f-4216-b046-690c4f978df6 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:22.560651 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480ba73-7c77-4480-9387-003aff6efd13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-2480ba73-7c77-4480-9387-003aff6efd13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:22.569770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:22.570694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:22.571557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 92/186] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:56:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:22.572795 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480ba73-7c77-4480-9387-003aff6efd13 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:22.601861 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:22.617988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067742a-c9f2-4ab4-a8c5-3727e6334456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:22.618655 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067742a-c9f2-4ab4-a8c5-3727e6334456 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.618958 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067742a-c9f2-4ab4-a8c5-3727e6334456 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.619963 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067742a-c9f2-4ab4-a8c5-3727e6334456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.620813 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067742a-c9f2-4ab4-a8c5-3727e6334456 None admin] RBAC: Adding query filter params (role.id=7bea6298af7e4980950949b024a1e103, scope.project.id=6ddb95693e344ac7bbb564d5056e6b7d, user.id=a751b52fcf40400e8553295a7aac987f) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:22.621176 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067742a-c9f2-4ab4-a8c5-3727e6334456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:22.622716 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067742a-c9f2-4ab4-a8c5-3727e6334456 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:22.630192 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 95/187] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:22 2022] GET /identity/v3/role_assignments?user.id=a751b52fcf40400e8553295a7aac987f&scope.project.id=6ddb95693e344ac7bbb564d5056e6b7d&role.id=7bea6298af7e4980950949b024a1e103 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:22.631216 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067742a-c9f2-4ab4-a8c5-3727e6334456 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:22.719594 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480ba73-7c77-4480-9387-003aff6efd13 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:22.763590 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678d6ff-c2b4-4643-81fe-02c41dd684a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:22.764539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678d6ff-c2b4-4643-81fe-02c41dd684a4 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.764902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678d6ff-c2b4-4643-81fe-02c41dd684a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.765300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678d6ff-c2b4-4643-81fe-02c41dd684a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.766789 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678d6ff-c2b4-4643-81fe-02c41dd684a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:22.768390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678d6ff-c2b4-4643-81fe-02c41dd684a4 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:22.770326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 93/188] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:22.776841 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678d6ff-c2b4-4643-81fe-02c41dd684a4 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:22.782206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067742a-c9f2-4ab4-a8c5-3727e6334456 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:22.822048 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b27a9e-9a77-4a7f-90b7-6cc829a5164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:22.823755 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b27a9e-9a77-4a7f-90b7-6cc829a5164a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.824219 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b27a9e-9a77-4a7f-90b7-6cc829a5164a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.824668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b27a9e-9a77-4a7f-90b7-6cc829a5164a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.836283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b27a9e-9a77-4a7f-90b7-6cc829a5164a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:22.840023 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-99b27a9e-9a77-4a7f-90b7-6cc829a5164a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:22.845845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:22.846763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:22.847768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 96/189] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:22.849255 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b27a9e-9a77-4a7f-90b7-6cc829a5164a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:22.904065 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678d6ff-c2b4-4643-81fe-02c41dd684a4 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:22.922848 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:22.954977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378f61a-a818-416f-b9e4-0640fb353af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:22.955897 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f61a-a818-416f-b9e4-0640fb353af3 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:22.956289 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f61a-a818-416f-b9e4-0640fb353af3 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:22.956701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f61a-a818-416f-b9e4-0640fb353af3 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:22.958227 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378f61a-a818-416f-b9e4-0640fb353af3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:22.958654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378f61a-a818-416f-b9e4-0640fb353af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:22.961078 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378f61a-a818-416f-b9e4-0640fb353af3 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:22.976028 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 94/190] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:22.976968 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378f61a-a818-416f-b9e4-0640fb353af3 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:22.986953 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b27a9e-9a77-4a7f-90b7-6cc829a5164a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:23.029339 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5baa3be-4578-49c1-9552-0363e537c58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:23.029934 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baa3be-4578-49c1-9552-0363e537c58a None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:23.030212 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baa3be-4578-49c1-9552-0363e537c58a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:23.030738 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baa3be-4578-49c1-9552-0363e537c58a None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:23.031224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5baa3be-4578-49c1-9552-0363e537c58a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:23.032690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5baa3be-4578-49c1-9552-0363e537c58a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:23.057962 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 97/191] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:56:22 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:56:23.059186 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5baa3be-4578-49c1-9552-0363e537c58a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:23.091470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378f61a-a818-416f-b9e4-0640fb353af3 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:23.109265 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:23.133604 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62401bbd-331d-49f6-a8c7-531bc6ad1b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:23.134299 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401bbd-331d-49f6-a8c7-531bc6ad1b68 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:23.134581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401bbd-331d-49f6-a8c7-531bc6ad1b68 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:23.135009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401bbd-331d-49f6-a8c7-531bc6ad1b68 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:23.135979 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401bbd-331d-49f6-a8c7-531bc6ad1b68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:23.136287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401bbd-331d-49f6-a8c7-531bc6ad1b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:23.137798 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401bbd-331d-49f6-a8c7-531bc6ad1b68 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:23.147640 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 95/192] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:23.148869 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4859cf6-1910-4c18-b4c1-2f4cdb4ec8c5 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:23.149166 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4859cf6-1910-4c18-b4c1-2f4cdb4ec8c5 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:23.149447 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4859cf6-1910-4c18-b4c1-2f4cdb4ec8c5 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:23.151578 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 96/193] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:23.156410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4859cf6-1910-4c18-b4c1-2f4cdb4ec8c5 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:23.204211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5baa3be-4578-49c1-9552-0363e537c58a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:23.212101 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:23.246952 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394421f6-ccf8-4c80-bc61-9ed9bd271db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:23.247856 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394421f6-ccf8-4c80-bc61-9ed9bd271db4 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:23.248143 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394421f6-ccf8-4c80-bc61-9ed9bd271db4 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:23.248424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394421f6-ccf8-4c80-bc61-9ed9bd271db4 None admin] PATH_INFO: `/v3/users/816458eb7525483cb00258c330d810f3` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:23.264204 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394421f6-ccf8-4c80-bc61-9ed9bd271db4 None admin] RBAC: Authorizing `identity:get_user(user_id=816458eb7525483cb00258c330d810f3)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:23.265691 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394421f6-ccf8-4c80-bc61-9ed9bd271db4 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:23.268031 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 98/194] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:23 2022] GET /identity/v3/users/816458eb7525483cb00258c330d810f3 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:23.269711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14bc10-7b04-4081-a86a-757f41f28268 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:23.269711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14bc10-7b04-4081-a86a-757f41f28268 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:23.269711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14bc10-7b04-4081-a86a-757f41f28268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:23.281434 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4859cf6-1910-4c18-b4c1-2f4cdb4ec8c5 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:23.295061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-3a14bc10-7b04-4081-a86a-757f41f28268 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:23.296478 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-3a14bc10-7b04-4081-a86a-757f41f28268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:23.319267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2587d-bb92-4d9f-9f6f-aebdb96851e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:23.320147 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2587d-bb92-4d9f-9f6f-aebdb96851e9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:23.320432 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2587d-bb92-4d9f-9f6f-aebdb96851e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:23.320707 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2587d-bb92-4d9f-9f6f-aebdb96851e9 None admin] PATH_INFO: `/v3/users/816458eb7525483cb00258c330d810f3` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:23.322705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2587d-bb92-4d9f-9f6f-aebdb96851e9 None admin] RBAC: Authorizing `identity:get_user(user_id=816458eb7525483cb00258c330d810f3)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:23.324795 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2587d-bb92-4d9f-9f6f-aebdb96851e9 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:23.326465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 97/195] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:23 2022] GET /identity/v3/users/816458eb7525483cb00258c330d810f3 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:23.331094 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2587d-bb92-4d9f-9f6f-aebdb96851e9 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:23.381513 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 99/196] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:23.383056 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14bc10-7b04-4081-a86a-757f41f28268 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:23.386946 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:23.456878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2587d-bb92-4d9f-9f6f-aebdb96851e9 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:23.500667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af858ff0-fc1e-497a-8d2b-27989d9e6a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:23.501314 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af858ff0-fc1e-497a-8d2b-27989d9e6a3e None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:23.501586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af858ff0-fc1e-497a-8d2b-27989d9e6a3e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:23.501856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af858ff0-fc1e-497a-8d2b-27989d9e6a3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:23.509171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:23.518659 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14bc10-7b04-4081-a86a-757f41f28268 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:23.567324 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa2dd-74e7-4d18-83cd-ff7400abd677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:23.568150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa2dd-74e7-4d18-83cd-ff7400abd677 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:23.568443 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa2dd-74e7-4d18-83cd-ff7400abd677 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:23.568760 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa2dd-74e7-4d18-83cd-ff7400abd677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:23.587108 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af858ff0-fc1e-497a-8d2b-27989d9e6a3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:23.589503 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af858ff0-fc1e-497a-8d2b-27989d9e6a3e None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:23.652552 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:23.655646 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaa2dd-74e7-4d18-83cd-ff7400abd677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:23.657286 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaa2dd-74e7-4d18-83cd-ff7400abd677 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:23.726474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 98/197] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:23.727657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af858ff0-fc1e-497a-8d2b-27989d9e6a3e None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:23.785647 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:23.795762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 100/198] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:23.797428 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa2dd-74e7-4d18-83cd-ff7400abd677 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:23.854507 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af858ff0-fc1e-497a-8d2b-27989d9e6a3e None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:23.898773 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79428-1f50-4e44-a4fd-df73874f500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:23.900792 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79428-1f50-4e44-a4fd-df73874f500d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:23.901297 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79428-1f50-4e44-a4fd-df73874f500d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:23.902078 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79428-1f50-4e44-a4fd-df73874f500d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:23.915495 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede79428-1f50-4e44-a4fd-df73874f500d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:23.921971 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa2dd-74e7-4d18-83cd-ff7400abd677 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-ede79428-1f50-4e44-a4fd-df73874f500d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:23.926371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:23.927420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:23.928404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:23.930440 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 99/199] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:23.936494 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79428-1f50-4e44-a4fd-df73874f500d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:23.941371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:23.966657 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f8bca-2970-47f6-82ff-443c886527dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:23.967754 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f8bca-2970-47f6-82ff-443c886527dd None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:23.968351 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f8bca-2970-47f6-82ff-443c886527dd None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:23.968467 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f8bca-2970-47f6-82ff-443c886527dd None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:23.970498 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f8bca-2970-47f6-82ff-443c886527dd None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:23.972171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f8bca-2970-47f6-82ff-443c886527dd None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:23.974464 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 101/200] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:23 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:23.975544 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f8bca-2970-47f6-82ff-443c886527dd None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:24.062958 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:24.082898 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79428-1f50-4e44-a4fd-df73874f500d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:24.104613 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f8bca-2970-47f6-82ff-443c886527dd None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:24.122273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527cfcd-bc37-464c-b0ac-84f2dd024f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:24.123644 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527cfcd-bc37-464c-b0ac-84f2dd024f78 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:24.124139 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527cfcd-bc37-464c-b0ac-84f2dd024f78 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:24.124716 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527cfcd-bc37-464c-b0ac-84f2dd024f78 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:24.126399 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527cfcd-bc37-464c-b0ac-84f2dd024f78 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:24.128214 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527cfcd-bc37-464c-b0ac-84f2dd024f78 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:24.130244 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 100/201] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:23 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:24.131522 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527cfcd-bc37-464c-b0ac-84f2dd024f78 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:24.146231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864321b-060b-404a-b075-2b02138599fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:24.147094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864321b-060b-404a-b075-2b02138599fb None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:24.147235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864321b-060b-404a-b075-2b02138599fb None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:24.147464 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864321b-060b-404a-b075-2b02138599fb None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:24.148205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864321b-060b-404a-b075-2b02138599fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:24.148589 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864321b-060b-404a-b075-2b02138599fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:24.149882 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864321b-060b-404a-b075-2b02138599fb None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:24.159513 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 102/202] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:24.160301 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864321b-060b-404a-b075-2b02138599fb None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:24.215533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:24.250699 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527cfcd-bc37-464c-b0ac-84f2dd024f78 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:24.265086 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864321b-060b-404a-b075-2b02138599fb None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:24.290053 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f381f5-21f4-4b6b-a08a-4c2c26ef9b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:24.290825 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:24.292381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f381f5-21f4-4b6b-a08a-4c2c26ef9b44 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:24.292923 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f381f5-21f4-4b6b-a08a-4c2c26ef9b44 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:24.293452 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f381f5-21f4-4b6b-a08a-4c2c26ef9b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:24.294621 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f381f5-21f4-4b6b-a08a-4c2c26ef9b44 None admin] RBAC: Adding query filter params (role.id=472a286d91bd484a83e2de07fc231c06, scope.project.id=f2fc6165f0384fac8e876908e84085e2, user.id=816458eb7525483cb00258c330d810f3) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:24.295159 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f381f5-21f4-4b6b-a08a-4c2c26ef9b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:24.296880 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f381f5-21f4-4b6b-a08a-4c2c26ef9b44 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:24.303624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb372-b010-48a4-b9a3-d4131966ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:24.304363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb372-b010-48a4-b9a3-d4131966ae01 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:24.304797 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb372-b010-48a4-b9a3-d4131966ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:24.304995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb372-b010-48a4-b9a3-d4131966ae01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:24.305195 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 101/203] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:24 2022] GET /identity/v3/role_assignments?user.id=816458eb7525483cb00258c330d810f3&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=472a286d91bd484a83e2de07fc231c06 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:24.305758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccb372-b010-48a4-b9a3-d4131966ae01 None admin] RBAC: Adding query filter params (role.id=65e129db80a94ccfba2808ee5768976e, scope.project.id=f2fc6165f0384fac8e876908e84085e2, user.id=816458eb7525483cb00258c330d810f3) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:24.306071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccb372-b010-48a4-b9a3-d4131966ae01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:24.306859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f381f5-21f4-4b6b-a08a-4c2c26ef9b44 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:24.316088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccb372-b010-48a4-b9a3-d4131966ae01 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:24.323434 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 103/204] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:24 2022] GET /identity/v3/role_assignments?user.id=816458eb7525483cb00258c330d810f3&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=65e129db80a94ccfba2808ee5768976e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:24.433465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f381f5-21f4-4b6b-a08a-4c2c26ef9b44 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:24.475188 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd3887-70a0-42ce-8e2f-cab931e86340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:24.476521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3887-70a0-42ce-8e2f-cab931e86340 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:24.477023 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3887-70a0-42ce-8e2f-cab931e86340 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:24.477515 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3887-70a0-42ce-8e2f-cab931e86340 None admin] PATH_INFO: `/v3/users/dbb3f436eaec4b8b8d2873bf7765ded4` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:24.479820 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd3887-70a0-42ce-8e2f-cab931e86340 None admin] RBAC: Authorizing `identity:get_user(user_id=dbb3f436eaec4b8b8d2873bf7765ded4)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:24.481683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd3887-70a0-42ce-8e2f-cab931e86340 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:24.484215 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 102/205] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:24 2022] GET /identity/v3/users/dbb3f436eaec4b8b8d2873bf7765ded4 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:24.491160 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb372-b010-48a4-b9a3-d4131966ae01 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:24.630668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb372-b010-48a4-b9a3-d4131966ae01 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:24.680311 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9625-1d96-4996-accc-6cc3202ea79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:24.680977 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9625-1d96-4996-accc-6cc3202ea79f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:24.681265 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9625-1d96-4996-accc-6cc3202ea79f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:24.681606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9625-1d96-4996-accc-6cc3202ea79f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:24.762789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:24.779990 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c9625-1d96-4996-accc-6cc3202ea79f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:24.781503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c9625-1d96-4996-accc-6cc3202ea79f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:24.919877 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 104/206] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:24.925401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd3887-70a0-42ce-8e2f-cab931e86340 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:24.929241 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:25.075093 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd3887-70a0-42ce-8e2f-cab931e86340 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:25.123424 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb5ab0-8b4d-4a7c-8c46-a82d0ea09402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:25.124306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb5ab0-8b4d-4a7c-8c46-a82d0ea09402 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:25.124594 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb5ab0-8b4d-4a7c-8c46-a82d0ea09402 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:25.124877 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb5ab0-8b4d-4a7c-8c46-a82d0ea09402 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:25.127914 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb5ab0-8b4d-4a7c-8c46-a82d0ea09402 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:25.129583 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb5ab0-8b4d-4a7c-8c46-a82d0ea09402 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:25.131579 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 103/207] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:24 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:25.138792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9625-1d96-4996-accc-6cc3202ea79f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:25.278788 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:25.292969 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9625-1d96-4996-accc-6cc3202ea79f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:25.344140 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bd448-ce95-48ca-b50d-329751812f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:25.345204 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bd448-ce95-48ca-b50d-329751812f2c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:25.345682 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bd448-ce95-48ca-b50d-329751812f2c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:25.346150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bd448-ce95-48ca-b50d-329751812f2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:25.347197 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bd448-ce95-48ca-b50d-329751812f2c None admin] RBAC: Adding query filter params (role.id=d1fa8990af404eefaf52fee0dc7d1811, scope.project.id=717b1694b0dd4e97b07cf61aeee56400, user.id=dbb3f436eaec4b8b8d2873bf7765ded4) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:25.347710 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bd448-ce95-48ca-b50d-329751812f2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:25.349431 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bd448-ce95-48ca-b50d-329751812f2c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:25.356497 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 105/208] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:25 2022] GET /identity/v3/role_assignments?user.id=dbb3f436eaec4b8b8d2873bf7765ded4&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=d1fa8990af404eefaf52fee0dc7d1811 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:25.898517 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2e2b4-6cba-4ecd-b04d-0bd117bbcd09 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:25.898879 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2e2b4-6cba-4ecd-b04d-0bd117bbcd09 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:25.899103 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2e2b4-6cba-4ecd-b04d-0bd117bbcd09 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:25.900526 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 104/209] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:25.909016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bedee5-17f0-4fc5-9a62-dccbd785f204 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:25.909503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bedee5-17f0-4fc5-9a62-dccbd785f204 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:25.909576 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bedee5-17f0-4fc5-9a62-dccbd785f204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:25.930385 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-e8bedee5-17f0-4fc5-9a62-dccbd785f204 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:25.932372 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-e8bedee5-17f0-4fc5-9a62-dccbd785f204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:25.943259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a4aee-2399-4bf1-a229-46f95c08d0d9 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:25.943259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a4aee-2399-4bf1-a229-46f95c08d0d9 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:25.943259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a4aee-2399-4bf1-a229-46f95c08d0d9 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:25.945067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 105/210] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:25.951243 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de5997-4c2e-42c9-b847-1f2bc0db0da6 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:25.951873 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de5997-4c2e-42c9-b847-1f2bc0db0da6 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:25.952348 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de5997-4c2e-42c9-b847-1f2bc0db0da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:25.977836 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-68de5997-4c2e-42c9-b847-1f2bc0db0da6 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:25.980552 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-68de5997-4c2e-42c9-b847-1f2bc0db0da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:26.046382 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 106/211] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:26.079012 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bedee5-17f0-4fc5-9a62-dccbd785f204 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:26.091703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 106/212] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:26.128220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de5997-4c2e-42c9-b847-1f2bc0db0da6 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:26.130658 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:26.192319 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:26.218304 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bedee5-17f0-4fc5-9a62-dccbd785f204 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:26.279182 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52746a-20c2-42fd-8651-0e4165c55066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:26.279995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52746a-20c2-42fd-8651-0e4165c55066 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:26.280279 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52746a-20c2-42fd-8651-0e4165c55066 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:26.280561 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52746a-20c2-42fd-8651-0e4165c55066 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:26.284202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52746a-20c2-42fd-8651-0e4165c55066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:26.288207 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52746a-20c2-42fd-8651-0e4165c55066 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:26.295063 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 107/213] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:26.296180 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52746a-20c2-42fd-8651-0e4165c55066 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:26.299992 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de5997-4c2e-42c9-b847-1f2bc0db0da6 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:26.339413 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489124e3-56f0-4db7-b610-e0bb6fd800e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:26.340572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489124e3-56f0-4db7-b610-e0bb6fd800e1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:26.341058 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489124e3-56f0-4db7-b610-e0bb6fd800e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:26.341533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489124e3-56f0-4db7-b610-e0bb6fd800e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:26.357199 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489124e3-56f0-4db7-b610-e0bb6fd800e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-489124e3-56f0-4db7-b610-e0bb6fd800e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:26.367029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:26.368059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:26.368982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:26.372379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 107/214] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:26.379331 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489124e3-56f0-4db7-b610-e0bb6fd800e1 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:26.436248 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52746a-20c2-42fd-8651-0e4165c55066 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:26.462471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:26.485781 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26983e99-10fb-40de-89ff-78f7a434889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:26.487334 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983e99-10fb-40de-89ff-78f7a434889e None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:26.487907 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983e99-10fb-40de-89ff-78f7a434889e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:26.488363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983e99-10fb-40de-89ff-78f7a434889e None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:26.489539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26983e99-10fb-40de-89ff-78f7a434889e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:26.491600 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26983e99-10fb-40de-89ff-78f7a434889e None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:26.505313 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489124e3-56f0-4db7-b610-e0bb6fd800e1 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:26.523772 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 108/215] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:56:26 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:56:26.551004 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7bfc8-5b70-461f-9783-c2a391dd699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:26.551967 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7bfc8-5b70-461f-9783-c2a391dd699d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:26.552349 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7bfc8-5b70-461f-9783-c2a391dd699d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:26.552725 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7bfc8-5b70-461f-9783-c2a391dd699d None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:26.553598 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7bfc8-5b70-461f-9783-c2a391dd699d None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:26.554009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7bfc8-5b70-461f-9783-c2a391dd699d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:26.555577 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7bfc8-5b70-461f-9783-c2a391dd699d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:26.566250 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 108/216] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:26.572811 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26983e99-10fb-40de-89ff-78f7a434889e None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:26.584287 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:26.698185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26983e99-10fb-40de-89ff-78f7a434889e None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:26.735934 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c338a-121d-471e-ae52-491414c8a81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:26.736735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c338a-121d-471e-ae52-491414c8a81e None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:26.737019 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c338a-121d-471e-ae52-491414c8a81e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:26.737297 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c338a-121d-471e-ae52-491414c8a81e None admin] PATH_INFO: `/v3/users/19e53d16eadc49a4b82928e171892ff0` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:26.753618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c338a-121d-471e-ae52-491414c8a81e None admin] RBAC: Authorizing `identity:get_user(user_id=19e53d16eadc49a4b82928e171892ff0)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:26.755112 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c338a-121d-471e-ae52-491414c8a81e None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:26.757178 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 109/217] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:26 2022] GET /identity/v3/users/19e53d16eadc49a4b82928e171892ff0 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:26.763388 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7bfc8-5b70-461f-9783-c2a391dd699d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:26.874600 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7bfc8-5b70-461f-9783-c2a391dd699d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:26.903165 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:26.917475 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5a178-9306-453f-8f92-2e2195a6e0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:26.918152 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5a178-9306-453f-8f92-2e2195a6e0a6 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:26.918440 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5a178-9306-453f-8f92-2e2195a6e0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:26.918718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5a178-9306-453f-8f92-2e2195a6e0a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.001347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5a178-9306-453f-8f92-2e2195a6e0a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:27.002731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5a178-9306-453f-8f92-2e2195a6e0a6 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:27.077219 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158daa4-f94c-4736-9f01-8e0533dd9028 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:27.077725 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158daa4-f94c-4736-9f01-8e0533dd9028 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:27.077799 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158daa4-f94c-4736-9f01-8e0533dd9028 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.079576 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 110/218] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:27.085196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671db3d1-6748-46ff-b1a1-a60e0a185f96 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:27.085490 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671db3d1-6748-46ff-b1a1-a60e0a185f96 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:27.085767 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671db3d1-6748-46ff-b1a1-a60e0a185f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.108279 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-671db3d1-6748-46ff-b1a1-a60e0a185f96 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:27.109484 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-671db3d1-6748-46ff-b1a1-a60e0a185f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:27.122587 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 109/219] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:27.128504 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5a178-9306-453f-8f92-2e2195a6e0a6 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:27.163730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:27.179250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:27.193740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 111/220] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:27.195075 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11399a-b228-437b-b31c-181ca93a8384 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:27.203481 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11399a-b228-437b-b31c-181ca93a8384 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:27.203783 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11399a-b228-437b-b31c-181ca93a8384 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.205229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 112/221] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:27.210729 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b80330-2e7a-44f1-b1ad-9aed2f84863a None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:27.211021 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b80330-2e7a-44f1-b1ad-9aed2f84863a None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:27.211331 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b80330-2e7a-44f1-b1ad-9aed2f84863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.245381 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-88b80330-2e7a-44f1-b1ad-9aed2f84863a None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:27.246829 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-88b80330-2e7a-44f1-b1ad-9aed2f84863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:27.253933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5a178-9306-453f-8f92-2e2195a6e0a6 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:27.308706 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ff105-393e-45ec-b28e-703b6ffb8ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:27.310062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ff105-393e-45ec-b28e-703b6ffb8ba8 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:27.310558 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ff105-393e-45ec-b28e-703b6ffb8ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:27.311033 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ff105-393e-45ec-b28e-703b6ffb8ba8 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.312759 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ff105-393e-45ec-b28e-703b6ffb8ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:27.314529 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ff105-393e-45ec-b28e-703b6ffb8ba8 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:27.321478 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 110/222] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:27 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:27.323371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ff105-393e-45ec-b28e-703b6ffb8ba8 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:27.346841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 113/223] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:27.348310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b80330-2e7a-44f1-b1ad-9aed2f84863a None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:27.439591 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:27.453294 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ff105-393e-45ec-b28e-703b6ffb8ba8 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:27.469609 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b80330-2e7a-44f1-b1ad-9aed2f84863a None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:27.496132 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:27.502169 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a0af4-3def-4a34-9f87-745a0bf47289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:27.502988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a0af4-3def-4a34-9f87-745a0bf47289 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:27.503296 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a0af4-3def-4a34-9f87-745a0bf47289 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:27.503575 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a0af4-3def-4a34-9f87-745a0bf47289 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.510643 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82fc8-8cea-49a2-b41b-49226a2cd723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:27.511754 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82fc8-8cea-49a2-b41b-49226a2cd723 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:27.512288 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82fc8-8cea-49a2-b41b-49226a2cd723 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:27.512757 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82fc8-8cea-49a2-b41b-49226a2cd723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.513851 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82fc8-8cea-49a2-b41b-49226a2cd723 None admin] RBAC: Adding query filter params (role.id=7bea6298af7e4980950949b024a1e103, scope.project.id=f2fc6165f0384fac8e876908e84085e2, user.id=19e53d16eadc49a4b82928e171892ff0) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:27.514360 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82fc8-8cea-49a2-b41b-49226a2cd723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:27.516051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82fc8-8cea-49a2-b41b-49226a2cd723 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:27.517296 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a0af4-3def-4a34-9f87-745a0bf47289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:27.522350 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 114/224] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:27 2022] GET /identity/v3/role_assignments?user.id=19e53d16eadc49a4b82928e171892ff0&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=7bea6298af7e4980950949b024a1e103 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-4a6a0af4-3def-4a34-9f87-745a0bf47289 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:27.527500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:27.528410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:27.529238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 111/225] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:27.532144 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82fc8-8cea-49a2-b41b-49226a2cd723 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:27.544003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a0af4-3def-4a34-9f87-745a0bf47289 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:27.750528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82fc8-8cea-49a2-b41b-49226a2cd723 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:27.759018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a0af4-3def-4a34-9f87-745a0bf47289 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:27.788373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9be245-682e-44ea-a465-3aa7885152e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:27.789087 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9be245-682e-44ea-a465-3aa7885152e2 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:27.789468 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9be245-682e-44ea-a465-3aa7885152e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:27.789748 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9be245-682e-44ea-a465-3aa7885152e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.803845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9be245-682e-44ea-a465-3aa7885152e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-8b9be245-682e-44ea-a465-3aa7885152e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:27.813032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:27.813925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:27.814903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 115/226] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:56:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:27.820418 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c468-f178-40c4-b6e4-ae1f08737fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:27.821092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c468-f178-40c4-b6e4-ae1f08737fbb None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:27.821374 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c468-f178-40c4-b6e4-ae1f08737fbb None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:27.821647 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c468-f178-40c4-b6e4-ae1f08737fbb None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.822919 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c468-f178-40c4-b6e4-ae1f08737fbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:27.823314 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c468-f178-40c4-b6e4-ae1f08737fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:27.824235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9be245-682e-44ea-a465-3aa7885152e2 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:27.826305 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c468-f178-40c4-b6e4-ae1f08737fbb None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:27.841274 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 112/227] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:27.856772 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c468-f178-40c4-b6e4-ae1f08737fbb None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:27.889650 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:27.895813 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:27.951545 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9be245-682e-44ea-a465-3aa7885152e2 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:27.988710 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72dd3e-249e-4e2b-aaa2-3515cfcfda4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:27.989490 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72dd3e-249e-4e2b-aaa2-3515cfcfda4a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:27.989781 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72dd3e-249e-4e2b-aaa2-3515cfcfda4a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:27.990060 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72dd3e-249e-4e2b-aaa2-3515cfcfda4a None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:27.990815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72dd3e-249e-4e2b-aaa2-3515cfcfda4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:27.991145 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72dd3e-249e-4e2b-aaa2-3515cfcfda4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:27.992665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72dd3e-249e-4e2b-aaa2-3515cfcfda4a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:28.001431 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 116/228] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:28.007508 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72dd3e-249e-4e2b-aaa2-3515cfcfda4a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:28.089568 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c468-f178-40c4-b6e4-ae1f08737fbb None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:28.115755 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72dd3e-249e-4e2b-aaa2-3515cfcfda4a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:28.131564 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:28.156397 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd6ea4-e4b7-4e54-a3d1-d113e227e300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:28.157144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628121f-ec7c-4dcc-bcca-0a03d87dd587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:28.157728 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6ea4-e4b7-4e54-a3d1-d113e227e300 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:28.158016 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628121f-ec7c-4dcc-bcca-0a03d87dd587 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:28.158199 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6ea4-e4b7-4e54-a3d1-d113e227e300 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:28.158315 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628121f-ec7c-4dcc-bcca-0a03d87dd587 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:28.158553 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628121f-ec7c-4dcc-bcca-0a03d87dd587 None admin] PATH_INFO: `/v3/users/816458eb7525483cb00258c330d810f3` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:28.158723 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6ea4-e4b7-4e54-a3d1-d113e227e300 None admin] PATH_INFO: `/v3/users/816458eb7525483cb00258c330d810f3` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:28.160141 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd6ea4-e4b7-4e54-a3d1-d113e227e300 None admin] RBAC: Authorizing `identity:get_user(user_id=816458eb7525483cb00258c330d810f3)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:28.161713 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd6ea4-e4b7-4e54-a3d1-d113e227e300 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:28.163827 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628121f-ec7c-4dcc-bcca-0a03d87dd587 None admin] RBAC: Authorizing `identity:get_user(user_id=816458eb7525483cb00258c330d810f3)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:28.163949 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 117/229] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:28 2022] GET /identity/v3/users/816458eb7525483cb00258c330d810f3 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:28.165276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628121f-ec7c-4dcc-bcca-0a03d87dd587 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:28.169490 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 113/230] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:27 2022] GET /identity/v3/users/816458eb7525483cb00258c330d810f3 => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:28.171398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd6ea4-e4b7-4e54-a3d1-d113e227e300 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:28.174593 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628121f-ec7c-4dcc-bcca-0a03d87dd587 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:28.277999 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:28.320753 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628121f-ec7c-4dcc-bcca-0a03d87dd587 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:28.385476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926cce5-0415-4ffb-8d56-c6c06ebe40fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:28.386769 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926cce5-0415-4ffb-8d56-c6c06ebe40fa None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:28.387325 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926cce5-0415-4ffb-8d56-c6c06ebe40fa None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:28.387839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926cce5-0415-4ffb-8d56-c6c06ebe40fa None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:28.389344 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926cce5-0415-4ffb-8d56-c6c06ebe40fa None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:28.391059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926cce5-0415-4ffb-8d56-c6c06ebe40fa None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:28.393365 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 114/231] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:28 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:28.397018 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd6ea4-e4b7-4e54-a3d1-d113e227e300 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:28.399426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926cce5-0415-4ffb-8d56-c6c06ebe40fa None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:28.463884 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100807e4-2d9b-4a33-b285-11a9a267197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:28.468648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100807e4-2d9b-4a33-b285-11a9a267197b None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:28.469220 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100807e4-2d9b-4a33-b285-11a9a267197b None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:28.469731 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100807e4-2d9b-4a33-b285-11a9a267197b None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:28.471280 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100807e4-2d9b-4a33-b285-11a9a267197b None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:28.473036 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100807e4-2d9b-4a33-b285-11a9a267197b None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:28.483316 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 118/232] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:28 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:28.487716 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100807e4-2d9b-4a33-b285-11a9a267197b None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:28.564421 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926cce5-0415-4ffb-8d56-c6c06ebe40fa None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:28.586830 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:28.632296 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60003563-60ec-4225-b699-dc8064d870f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:28.633469 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60003563-60ec-4225-b699-dc8064d870f3 None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:28.633759 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60003563-60ec-4225-b699-dc8064d870f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:28.634064 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60003563-60ec-4225-b699-dc8064d870f3 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2/users/816458eb7525483cb00258c330d810f3/roles/65e129db80a94ccfba2808ee5768976e` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:28.644532 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60003563-60ec-4225-b699-dc8064d870f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2fc6165f0384fac8e876908e84085e2, user_id=816458eb7525483cb00258c330d810f3, role_id=65e129db80a94ccfba2808ee5768976e)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:28.647629 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60003563-60ec-4225-b699-dc8064d870f3 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:28.675688 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 115/233] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:56:28 2022] PUT /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2/users/816458eb7525483cb00258c330d810f3/roles/65e129db80a94ccfba2808ee5768976e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:28.685214 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100807e4-2d9b-4a33-b285-11a9a267197b None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:28.747967 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3305ff3-e994-42c4-9f33-4138b88a6bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:28.748856 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305ff3-e994-42c4-9f33-4138b88a6bf5 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:28.749140 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305ff3-e994-42c4-9f33-4138b88a6bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:28.749413 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305ff3-e994-42c4-9f33-4138b88a6bf5 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2/users/816458eb7525483cb00258c330d810f3/roles/472a286d91bd484a83e2de07fc231c06` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:28.751417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3305ff3-e994-42c4-9f33-4138b88a6bf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2fc6165f0384fac8e876908e84085e2, user_id=816458eb7525483cb00258c330d810f3, role_id=472a286d91bd484a83e2de07fc231c06)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:28.752885 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3305ff3-e994-42c4-9f33-4138b88a6bf5 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:28.789058 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 119/234] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:56:28 2022] PUT /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2/users/816458eb7525483cb00258c330d810f3/roles/472a286d91bd484a83e2de07fc231c06 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 18:56:29.308220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f648b65-6839-4e73-a59a-0a3b3bda2f4b None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:29.309245 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f648b65-6839-4e73-a59a-0a3b3bda2f4b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:29.309847 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f648b65-6839-4e73-a59a-0a3b3bda2f4b None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:29.311470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 116/235] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:29.317648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe68005-5c6d-44d2-8ae3-669838f6c4d4 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:29.318476 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe68005-5c6d-44d2-8ae3-669838f6c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:29.318960 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe68005-5c6d-44d2-8ae3-669838f6c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:29.339285 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-7fe68005-5c6d-44d2-8ae3-669838f6c4d4 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:29.340817 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-7fe68005-5c6d-44d2-8ae3-669838f6c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:29.415453 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 120/236] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:29.440337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f648b65-6839-4e73-a59a-0a3b3bda2f4b None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:29.459657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:29.579737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f648b65-6839-4e73-a59a-0a3b3bda2f4b None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:29.620768 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307b719-e209-4c6f-a740-b5db9c995547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:29.621976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307b719-e209-4c6f-a740-b5db9c995547 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:29.622466 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307b719-e209-4c6f-a740-b5db9c995547 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:29.622987 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307b719-e209-4c6f-a740-b5db9c995547 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:29.642968 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307b719-e209-4c6f-a740-b5db9c995547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-e307b719-e209-4c6f-a740-b5db9c995547 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:29.652018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:29.652907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:29.653703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:29.660959 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 117/237] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:29.662618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe68005-5c6d-44d2-8ae3-669838f6c4d4 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:29.665430 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01988-b010-4b24-895a-aeb507cfb899 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:29.665757 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01988-b010-4b24-895a-aeb507cfb899 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:29.666545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01988-b010-4b24-895a-aeb507cfb899 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:29.668098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 118/238] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:56:29.673057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1824c0-fa4f-48b2-8250-8b9b528e02b4 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:29.673354 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1824c0-fa4f-48b2-8250-8b9b528e02b4 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:29.673687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1824c0-fa4f-48b2-8250-8b9b528e02b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:29.706876 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:29.709773 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-0c1824c0-fa4f-48b2-8250-8b9b528e02b4 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:29.711101 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-0c1824c0-fa4f-48b2-8250-8b9b528e02b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:29.797277 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe68005-5c6d-44d2-8ae3-669838f6c4d4 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:29.835832 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5346ec-1a63-40a7-a185-c84151bd0215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:29.836842 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5346ec-1a63-40a7-a185-c84151bd0215 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:29.837352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5346ec-1a63-40a7-a185-c84151bd0215 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:29.838631 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5346ec-1a63-40a7-a185-c84151bd0215 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:29.839631 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5346ec-1a63-40a7-a185-c84151bd0215 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:29.840280 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5346ec-1a63-40a7-a185-c84151bd0215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:29.841873 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5346ec-1a63-40a7-a185-c84151bd0215 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:29.851550 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 121/239] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:29.858074 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5346ec-1a63-40a7-a185-c84151bd0215 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:29.874543 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:29.880889 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 119/240] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:56:29.926903 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1824c0-fa4f-48b2-8250-8b9b528e02b4 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:29.999555 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:30.011593 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5346ec-1a63-40a7-a185-c84151bd0215 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:30.065613 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1824c0-fa4f-48b2-8250-8b9b528e02b4 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:30.078349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b0b1-6077-4d5a-9be6-0f06f6855fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:30.079268 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b0b1-6077-4d5a-9be6-0f06f6855fda None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:30.079532 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b0b1-6077-4d5a-9be6-0f06f6855fda None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:30.079963 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b0b1-6077-4d5a-9be6-0f06f6855fda None admin] PATH_INFO: `/v3/users/7f85a477eca34ea1b2826a27d9b0a0ac` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:30.098640 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96b0b1-6077-4d5a-9be6-0f06f6855fda None admin] RBAC: Authorizing `identity:get_user(user_id=7f85a477eca34ea1b2826a27d9b0a0ac)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:30.100707 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96b0b1-6077-4d5a-9be6-0f06f6855fda None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:30.102749 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 122/241] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:29 2022] GET /identity/v3/users/7f85a477eca34ea1b2826a27d9b0a0ac => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:30.111162 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b0b1-6077-4d5a-9be6-0f06f6855fda None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:30.124997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc5902-b465-4a5a-992f-5d28f18b550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:30.125806 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc5902-b465-4a5a-992f-5d28f18b550b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:30.126090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc5902-b465-4a5a-992f-5d28f18b550b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:30.126369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc5902-b465-4a5a-992f-5d28f18b550b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:30.129288 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc5902-b465-4a5a-992f-5d28f18b550b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:30.130775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc5902-b465-4a5a-992f-5d28f18b550b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:30.132546 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 120/242] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:30.140683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc5902-b465-4a5a-992f-5d28f18b550b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:30.287483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:30.321399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b0b1-6077-4d5a-9be6-0f06f6855fda None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:30.330563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc5902-b465-4a5a-992f-5d28f18b550b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:30.359217 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a219502-81b7-4b3b-9d59-97d7d0c0df12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:30.359788 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a219502-81b7-4b3b-9d59-97d7d0c0df12 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:30.360077 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a219502-81b7-4b3b-9d59-97d7d0c0df12 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:30.360456 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a219502-81b7-4b3b-9d59-97d7d0c0df12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:30.376084 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348ba9e-dd15-40c9-ad45-16d36a1bdee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:30.376763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348ba9e-dd15-40c9-ad45-16d36a1bdee4 None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:30.377306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348ba9e-dd15-40c9-ad45-16d36a1bdee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:30.377586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348ba9e-dd15-40c9-ad45-16d36a1bdee4 None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:30.378784 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348ba9e-dd15-40c9-ad45-16d36a1bdee4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:30.380813 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348ba9e-dd15-40c9-ad45-16d36a1bdee4 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:30.389389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:30.418215 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 121/243] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:56:30 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:56:30.419575 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecd63c-528a-4860-8cf1-3fd534c9094c None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:30.419867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecd63c-528a-4860-8cf1-3fd534c9094c None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:30.423265 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecd63c-528a-4860-8cf1-3fd534c9094c None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:30.424708 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 122/244] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:30.432603 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0898610-81b0-41e2-8730-a1c28f578b18 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:30.432603 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0898610-81b0-41e2-8730-a1c28f578b18 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:30.432969 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0898610-81b0-41e2-8730-a1c28f578b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:30.485386 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a219502-81b7-4b3b-9d59-97d7d0c0df12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:30.487011 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a219502-81b7-4b3b-9d59-97d7d0c0df12 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:30.490242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-c0898610-81b0-41e2-8730-a1c28f578b18 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:30.491526 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-c0898610-81b0-41e2-8730-a1c28f578b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:30.576333 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 123/245] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:30.600992 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0898610-81b0-41e2-8730-a1c28f578b18 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:30.652573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 123/246] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:30.658173 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a219502-81b7-4b3b-9d59-97d7d0c0df12 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:30.664237 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:30.723474 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:30.761393 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0898610-81b0-41e2-8730-a1c28f578b18 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:30.774264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a219502-81b7-4b3b-9d59-97d7d0c0df12 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:30.803918 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd132b1d-5fcc-4400-98c1-f01b9229b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:30.804997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd132b1d-5fcc-4400-98c1-f01b9229b3a9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:30.805282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd132b1d-5fcc-4400-98c1-f01b9229b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:30.805557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd132b1d-5fcc-4400-98c1-f01b9229b3a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:30.819442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd132b1d-5fcc-4400-98c1-f01b9229b3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:30.819623 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e1f6f-63ab-4b2a-a9d9-90bb2cb59b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:30.820758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e1f6f-63ab-4b2a-a9d9-90bb2cb59b22 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:30.821238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e1f6f-63ab-4b2a-a9d9-90bb2cb59b22 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:30.821706 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e1f6f-63ab-4b2a-a9d9-90bb2cb59b22 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:30.826039 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e1f6f-63ab-4b2a-a9d9-90bb2cb59b22 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-cd132b1d-5fcc-4400-98c1-f01b9229b3a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:30.827454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:30.828317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:30.829098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 124/247] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:56:30.830636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e1f6f-63ab-4b2a-a9d9-90bb2cb59b22 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:30.837088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 124/248] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:30 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:30.838398 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd132b1d-5fcc-4400-98c1-f01b9229b3a9 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:30.839147 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e1f6f-63ab-4b2a-a9d9-90bb2cb59b22 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:30.981400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd132b1d-5fcc-4400-98c1-f01b9229b3a9 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:30.988783 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e1f6f-63ab-4b2a-a9d9-90bb2cb59b22 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:31.002038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:31.029316 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:31.033275 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab021f-9589-4ae7-9a81-c1ab46ee1dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:31.034302 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab021f-9589-4ae7-9a81-c1ab46ee1dfb None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:31.034593 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab021f-9589-4ae7-9a81-c1ab46ee1dfb None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:31.034918 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab021f-9589-4ae7-9a81-c1ab46ee1dfb None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:31.035653 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab021f-9589-4ae7-9a81-c1ab46ee1dfb None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:31.035962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab021f-9589-4ae7-9a81-c1ab46ee1dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:31.037861 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab021f-9589-4ae7-9a81-c1ab46ee1dfb None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:31.043975 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92304-6258-4a78-95a0-33ce37ec316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:31.044966 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92304-6258-4a78-95a0-33ce37ec316c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:31.045458 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92304-6258-4a78-95a0-33ce37ec316c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:31.045937 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92304-6258-4a78-95a0-33ce37ec316c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:31.047008 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f92304-6258-4a78-95a0-33ce37ec316c None admin] RBAC: Adding query filter params (role.id=d1fa8990af404eefaf52fee0dc7d1811, scope.project.id=f2fc6165f0384fac8e876908e84085e2, user.id=7f85a477eca34ea1b2826a27d9b0a0ac) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:31.047555 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f92304-6258-4a78-95a0-33ce37ec316c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:31.048046 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 125/249] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:31.049392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f92304-6258-4a78-95a0-33ce37ec316c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:31.053803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab021f-9589-4ae7-9a81-c1ab46ee1dfb None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:31.057237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 125/250] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:30 2022] GET /identity/v3/role_assignments?user.id=7f85a477eca34ea1b2826a27d9b0a0ac&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=d1fa8990af404eefaf52fee0dc7d1811 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:31.174045 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab021f-9589-4ae7-9a81-c1ab46ee1dfb None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:31.213247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765d5c9-dbaa-49d4-a7ac-0348f418b487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:31.214509 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765d5c9-dbaa-49d4-a7ac-0348f418b487 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:31.215028 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765d5c9-dbaa-49d4-a7ac-0348f418b487 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:31.215572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765d5c9-dbaa-49d4-a7ac-0348f418b487 None admin] PATH_INFO: `/v3/users/19e53d16eadc49a4b82928e171892ff0` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:31.217159 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765d5c9-dbaa-49d4-a7ac-0348f418b487 None admin] RBAC: Authorizing `identity:get_user(user_id=19e53d16eadc49a4b82928e171892ff0)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:31.218903 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765d5c9-dbaa-49d4-a7ac-0348f418b487 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:31.221038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 126/251] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:31 2022] GET /identity/v3/users/19e53d16eadc49a4b82928e171892ff0 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:31.226673 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92304-6258-4a78-95a0-33ce37ec316c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:31.348859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92304-6258-4a78-95a0-33ce37ec316c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:31.386014 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685dc51-871e-47e3-8d16-b7ebd26b3cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:31.387333 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685dc51-871e-47e3-8d16-b7ebd26b3cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:31.387628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685dc51-871e-47e3-8d16-b7ebd26b3cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:31.387900 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685dc51-871e-47e3-8d16-b7ebd26b3cd4 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:31.389164 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685dc51-871e-47e3-8d16-b7ebd26b3cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:31.390626 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685dc51-871e-47e3-8d16-b7ebd26b3cd4 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:31.392750 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 126/252] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:31 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:31.398057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765d5c9-dbaa-49d4-a7ac-0348f418b487 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:31.442764 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09e38-a4cd-432f-b48e-948a7bc05eaa None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:31.443114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09e38-a4cd-432f-b48e-948a7bc05eaa None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:31.443365 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09e38-a4cd-432f-b48e-948a7bc05eaa None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:31.444861 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 127/253] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:31.450304 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7818491-8c7b-4830-85d3-7636165e580e None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:31.450597 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7818491-8c7b-4830-85d3-7636165e580e None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:31.450881 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7818491-8c7b-4830-85d3-7636165e580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:31.475510 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:31.485837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-a7818491-8c7b-4830-85d3-7636165e580e None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:31.487036 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-a7818491-8c7b-4830-85d3-7636165e580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:31.530062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765d5c9-dbaa-49d4-a7ac-0348f418b487 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:31.573875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c146753-3a5a-4f10-8b0c-920f3708267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:31.575200 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c146753-3a5a-4f10-8b0c-920f3708267f None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:31.575908 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c146753-3a5a-4f10-8b0c-920f3708267f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:31.576388 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c146753-3a5a-4f10-8b0c-920f3708267f None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2/users/19e53d16eadc49a4b82928e171892ff0/roles/7bea6298af7e4980950949b024a1e103` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:31.583431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c146753-3a5a-4f10-8b0c-920f3708267f None admin] RBAC: Authorizing `identity:create_grant(project_id=f2fc6165f0384fac8e876908e84085e2, user_id=19e53d16eadc49a4b82928e171892ff0, role_id=7bea6298af7e4980950949b024a1e103)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:31.585159 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c146753-3a5a-4f10-8b0c-920f3708267f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:31.606823 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:31.621831 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 127/254] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:56:31 2022] PUT /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2/users/19e53d16eadc49a4b82928e171892ff0/roles/7bea6298af7e4980950949b024a1e103 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:31.645118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 128/255] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:31.692032 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c146753-3a5a-4f10-8b0c-920f3708267f None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:31.833761 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c146753-3a5a-4f10-8b0c-920f3708267f None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:31.841449 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:31.887479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d3a32-873b-46ad-afd9-52e741c0ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:31.888651 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d3a32-873b-46ad-afd9-52e741c0ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:31.889163 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d3a32-873b-46ad-afd9-52e741c0ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:31.889651 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d3a32-873b-46ad-afd9-52e741c0ecf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:31.908093 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d3a32-873b-46ad-afd9-52e741c0ecf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-b00d3a32-873b-46ad-afd9-52e741c0ecf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:31.916858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:31.917839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:31.919379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 128/256] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:31.928252 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7818491-8c7b-4830-85d3-7636165e580e None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:32.062638 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7818491-8c7b-4830-85d3-7636165e580e None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:32.105965 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4182b8d-4008-404c-9ef1-4bf21ec806f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:32.107589 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182b8d-4008-404c-9ef1-4bf21ec806f7 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:32.108081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182b8d-4008-404c-9ef1-4bf21ec806f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:32.108573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182b8d-4008-404c-9ef1-4bf21ec806f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:32.109615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4182b8d-4008-404c-9ef1-4bf21ec806f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:32.110128 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4182b8d-4008-404c-9ef1-4bf21ec806f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:32.111754 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4182b8d-4008-404c-9ef1-4bf21ec806f7 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:32.126430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 129/257] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:32.136208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d3a32-873b-46ad-afd9-52e741c0ecf9 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:32.151699 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786a1c-3da9-45ed-a5cb-9abaa9b7da93 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:32.153577 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786a1c-3da9-45ed-a5cb-9abaa9b7da93 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:32.154065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786a1c-3da9-45ed-a5cb-9abaa9b7da93 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:32.156167 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 130/258] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:32.164543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312ef2-28fb-4417-af35-92d47e863b50 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:32.164831 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312ef2-28fb-4417-af35-92d47e863b50 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:32.165109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312ef2-28fb-4417-af35-92d47e863b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:32.202164 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-41312ef2-28fb-4417-af35-92d47e863b50 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:32.203524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-41312ef2-28fb-4417-af35-92d47e863b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:32.296875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d3a32-873b-46ad-afd9-52e741c0ecf9 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:32.301567 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:32.361349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 131/259] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:32.365536 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e25448-a89d-40af-8f9a-0b6f667c2b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:32.366663 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e25448-a89d-40af-8f9a-0b6f667c2b9c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:32.367171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e25448-a89d-40af-8f9a-0b6f667c2b9c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:32.367676 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e25448-a89d-40af-8f9a-0b6f667c2b9c None admin] PATH_INFO: `/v3/users/816458eb7525483cb00258c330d810f3` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:32.371848 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e25448-a89d-40af-8f9a-0b6f667c2b9c None admin] RBAC: Authorizing `identity:get_user(user_id=816458eb7525483cb00258c330d810f3)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:32.373557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e25448-a89d-40af-8f9a-0b6f667c2b9c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:32.375724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 129/260] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:32 2022] GET /identity/v3/users/816458eb7525483cb00258c330d810f3 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:32.381040 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41312ef2-28fb-4417-af35-92d47e863b50 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:32.400096 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e25448-a89d-40af-8f9a-0b6f667c2b9c None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:32.459505 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:32.565234 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41312ef2-28fb-4417-af35-92d47e863b50 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:32.633977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e25448-a89d-40af-8f9a-0b6f667c2b9c None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:32.637736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf52561-6f1e-44db-b51b-4cc5cae4e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:32.638410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf52561-6f1e-44db-b51b-4cc5cae4e591 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:32.638702 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf52561-6f1e-44db-b51b-4cc5cae4e591 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:32.638985 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf52561-6f1e-44db-b51b-4cc5cae4e591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:32.699872 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc71ec-dfe1-412f-ae4a-791baa59b2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:32.701041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc71ec-dfe1-412f-ae4a-791baa59b2fa None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:32.701532 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc71ec-dfe1-412f-ae4a-791baa59b2fa None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:32.702012 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc71ec-dfe1-412f-ae4a-791baa59b2fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:32.732160 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc71ec-dfe1-412f-ae4a-791baa59b2fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-61fc71ec-dfe1-412f-ae4a-791baa59b2fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:32.748965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:32.749966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:32.750800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:32.753839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 130/261] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:56:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:32.759387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:32.760515 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc71ec-dfe1-412f-ae4a-791baa59b2fa None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:32.820441 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf52561-6f1e-44db-b51b-4cc5cae4e591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:32.822498 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf52561-6f1e-44db-b51b-4cc5cae4e591 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:32.951503 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:32.960455 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc71ec-dfe1-412f-ae4a-791baa59b2fa None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:33.036418 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181e82c-d52f-4a99-b5e1-b158c234b11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:33.038483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181e82c-d52f-4a99-b5e1-b158c234b11f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:33.039184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181e82c-d52f-4a99-b5e1-b158c234b11f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:33.040331 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181e82c-d52f-4a99-b5e1-b158c234b11f None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:33.041973 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181e82c-d52f-4a99-b5e1-b158c234b11f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:33.042634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181e82c-d52f-4a99-b5e1-b158c234b11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:33.044832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181e82c-d52f-4a99-b5e1-b158c234b11f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:33.049524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 132/262] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:33.055475 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf52561-6f1e-44db-b51b-4cc5cae4e591 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:33.066398 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 131/263] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:33.067724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181e82c-d52f-4a99-b5e1-b158c234b11f None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:33.201153 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:33.239931 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf52561-6f1e-44db-b51b-4cc5cae4e591 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:33.253939 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181e82c-d52f-4a99-b5e1-b158c234b11f None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:33.365007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340cc34-ab5d-4c50-9ddd-6ea4872e5b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:33.366530 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340cc34-ab5d-4c50-9ddd-6ea4872e5b10 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:33.367023 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340cc34-ab5d-4c50-9ddd-6ea4872e5b10 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:33.367524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340cc34-ab5d-4c50-9ddd-6ea4872e5b10 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:33.370791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340cc34-ab5d-4c50-9ddd-6ea4872e5b10 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:33.373202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340cc34-ab5d-4c50-9ddd-6ea4872e5b10 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:33.375328 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 133/264] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:33 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:33.381407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340cc34-ab5d-4c50-9ddd-6ea4872e5b10 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:33.387301 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aa9dd-99f1-4029-bef1-93eb65469325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:33.395155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aa9dd-99f1-4029-bef1-93eb65469325 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:33.395686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aa9dd-99f1-4029-bef1-93eb65469325 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:33.396174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aa9dd-99f1-4029-bef1-93eb65469325 None admin] PATH_INFO: `/v3/users/816458eb7525483cb00258c330d810f3` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:33.397655 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263aa9dd-99f1-4029-bef1-93eb65469325 None admin] RBAC: Authorizing `identity:get_user(user_id=816458eb7525483cb00258c330d810f3)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:33.399332 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263aa9dd-99f1-4029-bef1-93eb65469325 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:33.402365 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 132/265] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:33 2022] GET /identity/v3/users/816458eb7525483cb00258c330d810f3 => generated 283 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:33.408077 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aa9dd-99f1-4029-bef1-93eb65469325 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:33.468799 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:33.574117 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340cc34-ab5d-4c50-9ddd-6ea4872e5b10 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:33.613154 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce7ea-0122-459d-b7f5-fa3b95bea6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:33.614085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce7ea-0122-459d-b7f5-fa3b95bea6d4 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:33.614680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce7ea-0122-459d-b7f5-fa3b95bea6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:33.615232 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce7ea-0122-459d-b7f5-fa3b95bea6d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:33.616343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ce7ea-0122-459d-b7f5-fa3b95bea6d4 None admin] RBAC: Adding query filter params (role.id=65e129db80a94ccfba2808ee5768976e, scope.project.id=f2fc6165f0384fac8e876908e84085e2, user.id=816458eb7525483cb00258c330d810f3) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:33.616892 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ce7ea-0122-459d-b7f5-fa3b95bea6d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:33.618633 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ce7ea-0122-459d-b7f5-fa3b95bea6d4 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:33.625768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 134/266] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:33 2022] GET /identity/v3/role_assignments?user.id=816458eb7525483cb00258c330d810f3&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=65e129db80a94ccfba2808ee5768976e => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:33.695291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aa9dd-99f1-4029-bef1-93eb65469325 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:33.741689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadaa4c-42f7-4bee-8695-dc97083234a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:33.742354 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadaa4c-42f7-4bee-8695-dc97083234a9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:33.742643 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadaa4c-42f7-4bee-8695-dc97083234a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:33.742921 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadaa4c-42f7-4bee-8695-dc97083234a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:33.849443 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadaa4c-42f7-4bee-8695-dc97083234a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:33.850956 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadaa4c-42f7-4bee-8695-dc97083234a9 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:33.886729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:34.018252 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 133/267] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:34.023539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce7ea-0122-459d-b7f5-fa3b95bea6d4 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:34.046934 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:34.164384 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce7ea-0122-459d-b7f5-fa3b95bea6d4 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:34.206844 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820cdcc-30c2-4171-9e9f-4c2e3ffecdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:34.207748 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820cdcc-30c2-4171-9e9f-4c2e3ffecdbb None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.208307 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820cdcc-30c2-4171-9e9f-4c2e3ffecdbb None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.208582 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820cdcc-30c2-4171-9e9f-4c2e3ffecdbb None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:34.209774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820cdcc-30c2-4171-9e9f-4c2e3ffecdbb None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:34.211433 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820cdcc-30c2-4171-9e9f-4c2e3ffecdbb None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:34.213667 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 135/268] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:34 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:34.219977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadaa4c-42f7-4bee-8695-dc97083234a9 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:34.332404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadaa4c-42f7-4bee-8695-dc97083234a9 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:34.361857 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:34.363491 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dae57-141c-4457-98f8-340c023f2c5f None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.363783 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dae57-141c-4457-98f8-340c023f2c5f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.364062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dae57-141c-4457-98f8-340c023f2c5f None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:34.365690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 136/269] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:34.372003 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e87d6-c2e3-4e76-85a3-0a15ab75223b None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.372296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e87d6-c2e3-4e76-85a3-0a15ab75223b None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.372583 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e87d6-c2e3-4e76-85a3-0a15ab75223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:34.376484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb50c38-2aab-418e-8baf-58b53b62071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:34.377142 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb50c38-2aab-418e-8baf-58b53b62071f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.377426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb50c38-2aab-418e-8baf-58b53b62071f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.377703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb50c38-2aab-418e-8baf-58b53b62071f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:34.378534 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb50c38-2aab-418e-8baf-58b53b62071f None admin] RBAC: Adding query filter params (role.id=472a286d91bd484a83e2de07fc231c06, scope.project.id=f2fc6165f0384fac8e876908e84085e2, user.id=816458eb7525483cb00258c330d810f3) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:34.378848 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb50c38-2aab-418e-8baf-58b53b62071f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:34.380341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb50c38-2aab-418e-8baf-58b53b62071f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:34.387013 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 134/270] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:34 2022] GET /identity/v3/role_assignments?user.id=816458eb7525483cb00258c330d810f3&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=472a286d91bd484a83e2de07fc231c06 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:34.424522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-fe3e87d6-c2e3-4e76-85a3-0a15ab75223b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:34.425686 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-fe3e87d6-c2e3-4e76-85a3-0a15ab75223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:34.497334 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997568-f5db-4310-97d5-faa9ffd75e34 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.497842 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997568-f5db-4310-97d5-faa9ffd75e34 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.497915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997568-f5db-4310-97d5-faa9ffd75e34 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:34.500161 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 135/271] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:34.506338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c5a1-9c38-4451-b2f2-9b791cebc78a None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.506907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c5a1-9c38-4451-b2f2-9b791cebc78a None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.507501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c5a1-9c38-4451-b2f2-9b791cebc78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:34.533322 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-64e0c5a1-9c38-4451-b2f2-9b791cebc78a None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:34.535243 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-64e0c5a1-9c38-4451-b2f2-9b791cebc78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:34.557081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 137/272] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:34.593205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5f007-5757-4da9-a5fd-c8ddc5c6d179 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.593858 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5f007-5757-4da9-a5fd-c8ddc5c6d179 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.594342 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5f007-5757-4da9-a5fd-c8ddc5c6d179 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:34.596274 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 138/273] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:56:34.597247 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5f007-5757-4da9-a5fd-c8ddc5c6d179 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:34.615327 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:34.624386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 136/274] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:34.625539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9454bc7-ffe1-4f10-9e3e-7d56ab330c18 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.626075 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9454bc7-ffe1-4f10-9e3e-7d56ab330c18 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.627670 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9454bc7-ffe1-4f10-9e3e-7d56ab330c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:34.653035 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-f9454bc7-ffe1-4f10-9e3e-7d56ab330c18 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:34.654597 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-f9454bc7-ffe1-4f10-9e3e-7d56ab330c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:34.747892 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5f007-5757-4da9-a5fd-c8ddc5c6d179 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:34.755287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 137/275] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:34.756477 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9454bc7-ffe1-4f10-9e3e-7d56ab330c18 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:34.798012 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5469-f792-43d6-adee-33528b62efd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:34.799109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5469-f792-43d6-adee-33528b62efd5 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.799574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5469-f792-43d6-adee-33528b62efd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.800230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5469-f792-43d6-adee-33528b62efd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:34.813606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:34.815359 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5469-f792-43d6-adee-33528b62efd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-460b5469-f792-43d6-adee-33528b62efd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:34.825802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:34.826711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:34.827628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:34.828214 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 139/276] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:34.831977 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5469-f792-43d6-adee-33528b62efd5 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:34.875258 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9454bc7-ffe1-4f10-9e3e-7d56ab330c18 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:34.911196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:34.922892 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef17119-20c3-4f1a-b0ac-eb86730f36f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:34.923715 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef17119-20c3-4f1a-b0ac-eb86730f36f8 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.924005 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef17119-20c3-4f1a-b0ac-eb86730f36f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.924290 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef17119-20c3-4f1a-b0ac-eb86730f36f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:34.925735 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef17119-20c3-4f1a-b0ac-eb86730f36f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:34.931185 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef17119-20c3-4f1a-b0ac-eb86730f36f8 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:34.938442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 138/277] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:34.938442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef17119-20c3-4f1a-b0ac-eb86730f36f8 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:34.956349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5469-f792-43d6-adee-33528b62efd5 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:34.995461 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dba80-dece-46f1-939a-8cd4d8bd4c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:34.996401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dba80-dece-46f1-939a-8cd4d8bd4c41 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:34.996690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dba80-dece-46f1-939a-8cd4d8bd4c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:34.996970 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dba80-dece-46f1-939a-8cd4d8bd4c41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.007842 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dba80-dece-46f1-939a-8cd4d8bd4c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-3c0dba80-dece-46f1-939a-8cd4d8bd4c41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:35.016231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:35.017229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:35.019022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 140/278] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:35.020541 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dba80-dece-46f1-939a-8cd4d8bd4c41 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:35.045435 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef17119-20c3-4f1a-b0ac-eb86730f36f8 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:35.060000 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:35.081092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9db71f-4c05-48ac-bbd1-c634d97215b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:35.081749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9db71f-4c05-48ac-bbd1-c634d97215b2 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:35.082034 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9db71f-4c05-48ac-bbd1-c634d97215b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:35.082307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9db71f-4c05-48ac-bbd1-c634d97215b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.083043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9db71f-4c05-48ac-bbd1-c634d97215b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:35.083377 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9db71f-4c05-48ac-bbd1-c634d97215b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:35.084752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9db71f-4c05-48ac-bbd1-c634d97215b2 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:35.092634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 139/279] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:35.093405 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9db71f-4c05-48ac-bbd1-c634d97215b2 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:35.124120 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dba80-dece-46f1-939a-8cd4d8bd4c41 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:35.150266 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:35.158683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa101097-2dd0-4c6f-a8b2-999f847361ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:35.159382 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa101097-2dd0-4c6f-a8b2-999f847361ad None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:35.159673 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa101097-2dd0-4c6f-a8b2-999f847361ad None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:35.159955 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa101097-2dd0-4c6f-a8b2-999f847361ad None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.160662 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa101097-2dd0-4c6f-a8b2-999f847361ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:35.162150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa101097-2dd0-4c6f-a8b2-999f847361ad None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:35.184191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 141/280] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:56:35 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:56:35.185631 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21d505-9aa6-4fec-bba4-dc29fcea828a None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:35.185924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21d505-9aa6-4fec-bba4-dc29fcea828a None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:35.186421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21d505-9aa6-4fec-bba4-dc29fcea828a None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.187630 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 142/281] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:35.188192 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21d505-9aa6-4fec-bba4-dc29fcea828a None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:35.203638 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9db71f-4c05-48ac-bbd1-c634d97215b2 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:35.253375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2b137-d8ce-4f48-a7da-dc2ef6cfa2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:35.254317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b137-d8ce-4f48-a7da-dc2ef6cfa2e5 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:35.254744 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b137-d8ce-4f48-a7da-dc2ef6cfa2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:35.255204 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b137-d8ce-4f48-a7da-dc2ef6cfa2e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.256114 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2b137-d8ce-4f48-a7da-dc2ef6cfa2e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:35.256600 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2b137-d8ce-4f48-a7da-dc2ef6cfa2e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:35.258466 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2b137-d8ce-4f48-a7da-dc2ef6cfa2e5 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:35.269417 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 140/282] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:35.272597 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed7e3b-c529-43df-8a96-0408f92cc00f None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:35.273048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed7e3b-c529-43df-8a96-0408f92cc00f None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:35.273406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed7e3b-c529-43df-8a96-0408f92cc00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.294295 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-62ed7e3b-c529-43df-8a96-0408f92cc00f None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:35.295806 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-62ed7e3b-c529-43df-8a96-0408f92cc00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:35.321196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21d505-9aa6-4fec-bba4-dc29fcea828a None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:35.330871 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:35.362636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f8997-67ca-49aa-8e35-b4a7a62197f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:35.363546 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f8997-67ca-49aa-8e35-b4a7a62197f0 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:35.363827 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f8997-67ca-49aa-8e35-b4a7a62197f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:35.364101 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f8997-67ca-49aa-8e35-b4a7a62197f0 None admin] PATH_INFO: `/v3/users/7f85a477eca34ea1b2826a27d9b0a0ac` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.365317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f8997-67ca-49aa-8e35-b4a7a62197f0 None admin] RBAC: Authorizing `identity:get_user(user_id=7f85a477eca34ea1b2826a27d9b0a0ac)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:35.366900 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f8997-67ca-49aa-8e35-b4a7a62197f0 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:35.368578 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 143/283] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:35 2022] GET /identity/v3/users/7f85a477eca34ea1b2826a27d9b0a0ac => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:35.370009 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f8997-67ca-49aa-8e35-b4a7a62197f0 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:35.382100 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 141/284] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:35.383450 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed7e3b-c529-43df-8a96-0408f92cc00f None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:35.442352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:35.500742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f8997-67ca-49aa-8e35-b4a7a62197f0 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:35.501791 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed7e3b-c529-43df-8a96-0408f92cc00f None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:35.544934 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45b71a-2463-476d-8144-420906595e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:35.546051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45b71a-2463-476d-8144-420906595e12 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:35.546482 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45b71a-2463-476d-8144-420906595e12 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:35.547007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45b71a-2463-476d-8144-420906595e12 None admin] PATH_INFO: `/v3/users/e25b0221fd7246e8b9460b4f1fdf10b6` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.550267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8081c34-96b2-4cd3-befb-411ae1e439a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:35.551436 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8081c34-96b2-4cd3-befb-411ae1e439a3 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:35.551551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8081c34-96b2-4cd3-befb-411ae1e439a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:35.551836 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8081c34-96b2-4cd3-befb-411ae1e439a3 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.554443 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8081c34-96b2-4cd3-befb-411ae1e439a3 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:35.557285 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8081c34-96b2-4cd3-befb-411ae1e439a3 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:35.558148 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 142/285] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:35 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:35.559161 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8081c34-96b2-4cd3-befb-411ae1e439a3 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:35.568401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45b71a-2463-476d-8144-420906595e12 None admin] RBAC: Authorizing `identity:get_user(user_id=e25b0221fd7246e8b9460b4f1fdf10b6)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:35.569929 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45b71a-2463-476d-8144-420906595e12 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:35.572852 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 144/286] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:35 2022] GET /identity/v3/users/e25b0221fd7246e8b9460b4f1fdf10b6 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:35.574639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45b71a-2463-476d-8144-420906595e12 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:35.604433 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:35.710347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8081c34-96b2-4cd3-befb-411ae1e439a3 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:35.715664 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45b71a-2463-476d-8144-420906595e12 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:35.731114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:35.763285 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889360aa-bcfd-4302-94f6-7badbf9fb27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:35.763825 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdba57b-4008-476b-a4fe-61dd8845e9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:35.764181 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889360aa-bcfd-4302-94f6-7badbf9fb27d None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:35.764469 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889360aa-bcfd-4302-94f6-7badbf9fb27d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:35.764751 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889360aa-bcfd-4302-94f6-7badbf9fb27d None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2/users/7f85a477eca34ea1b2826a27d9b0a0ac/roles/d1fa8990af404eefaf52fee0dc7d1811` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.765498 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdba57b-4008-476b-a4fe-61dd8845e9fc None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:35.765980 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdba57b-4008-476b-a4fe-61dd8845e9fc None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:35.766471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdba57b-4008-476b-a4fe-61dd8845e9fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:35.766853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889360aa-bcfd-4302-94f6-7badbf9fb27d None admin] RBAC: Authorizing `identity:create_grant(project_id=f2fc6165f0384fac8e876908e84085e2, user_id=7f85a477eca34ea1b2826a27d9b0a0ac, role_id=d1fa8990af404eefaf52fee0dc7d1811)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:35.768392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889360aa-bcfd-4302-94f6-7badbf9fb27d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:35.781221 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdba57b-4008-476b-a4fe-61dd8845e9fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:35.783722 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 145/287] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:56:35 2022] PUT /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2/users/7f85a477eca34ea1b2826a27d9b0a0ac/roles/d1fa8990af404eefaf52fee0dc7d1811 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:35.784611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889360aa-bcfd-4302-94f6-7badbf9fb27d None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-0bdba57b-4008-476b-a4fe-61dd8845e9fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:35.792089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:35.793063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:35.793884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:35.796971 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 143/288] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:35.804385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdba57b-4008-476b-a4fe-61dd8845e9fc None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:35.931312 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889360aa-bcfd-4302-94f6-7badbf9fb27d None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:35.997957 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:36.005344 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdba57b-4008-476b-a4fe-61dd8845e9fc None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:36.023912 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091e174-1371-4e23-a615-3a17b623e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:36.024592 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091e174-1371-4e23-a615-3a17b623e0ac None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:36.025393 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091e174-1371-4e23-a615-3a17b623e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:36.025846 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091e174-1371-4e23-a615-3a17b623e0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:36.026700 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091e174-1371-4e23-a615-3a17b623e0ac None admin] RBAC: Adding query filter params (role.id=7bea6298af7e4980950949b024a1e103, user.id=e25b0221fd7246e8b9460b4f1fdf10b6, scope.system=all) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:36.027017 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091e174-1371-4e23-a615-3a17b623e0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:36.028553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091e174-1371-4e23-a615-3a17b623e0ac None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:36.042712 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 146/289] 10.222.0.98 () {56 vars in 1308 bytes} [Mon Jul 25 18:56:35 2022] GET /identity/v3/role_assignments?user.id=e25b0221fd7246e8b9460b4f1fdf10b6&scope.system=all&role.id=7bea6298af7e4980950949b024a1e103 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:36.045451 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d908b5d-813a-4311-aa3f-ae55cd6ed2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:36.046138 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d908b5d-813a-4311-aa3f-ae55cd6ed2f0 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:36.046428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d908b5d-813a-4311-aa3f-ae55cd6ed2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:36.046712 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d908b5d-813a-4311-aa3f-ae55cd6ed2f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:36.047583 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d908b5d-813a-4311-aa3f-ae55cd6ed2f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:36.047846 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d908b5d-813a-4311-aa3f-ae55cd6ed2f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:36.049261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d908b5d-813a-4311-aa3f-ae55cd6ed2f0 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:36.060274 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 144/290] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:36.065969 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091e174-1371-4e23-a615-3a17b623e0ac None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:36.109318 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:36.189364 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091e174-1371-4e23-a615-3a17b623e0ac None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:36.229707 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626b384-5eb7-48c2-9d54-ea4164aed180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:36.230595 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b384-5eb7-48c2-9d54-ea4164aed180 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:36.230883 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b384-5eb7-48c2-9d54-ea4164aed180 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:36.231188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b384-5eb7-48c2-9d54-ea4164aed180 None admin] PATH_INFO: `/v3/users/19e53d16eadc49a4b82928e171892ff0` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:36.232470 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626b384-5eb7-48c2-9d54-ea4164aed180 None admin] RBAC: Authorizing `identity:get_user(user_id=19e53d16eadc49a4b82928e171892ff0)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:36.233983 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626b384-5eb7-48c2-9d54-ea4164aed180 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:36.235827 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 147/291] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:36 2022] GET /identity/v3/users/19e53d16eadc49a4b82928e171892ff0 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:36.241133 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d908b5d-813a-4311-aa3f-ae55cd6ed2f0 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:36.363756 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d908b5d-813a-4311-aa3f-ae55cd6ed2f0 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:36.398885 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117b37e-73af-477f-bd59-0050e0822d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:36.399580 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117b37e-73af-477f-bd59-0050e0822d42 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:36.399897 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117b37e-73af-477f-bd59-0050e0822d42 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:36.400725 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117b37e-73af-477f-bd59-0050e0822d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:36.439332 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:36.494324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117b37e-73af-477f-bd59-0050e0822d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:36.495825 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117b37e-73af-477f-bd59-0050e0822d42 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:36.622568 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 145/292] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:36.627948 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626b384-5eb7-48c2-9d54-ea4164aed180 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:36.738572 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626b384-5eb7-48c2-9d54-ea4164aed180 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:36.740174 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:36.775697 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edb2f8-bef4-42db-a0c4-f2c097f9b636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:36.776579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb2f8-bef4-42db-a0c4-f2c097f9b636 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:36.776868 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb2f8-bef4-42db-a0c4-f2c097f9b636 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:36.777149 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb2f8-bef4-42db-a0c4-f2c097f9b636 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:36.778371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edb2f8-bef4-42db-a0c4-f2c097f9b636 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:36.779871 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edb2f8-bef4-42db-a0c4-f2c097f9b636 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:36.781744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 148/293] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:36 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:36.787456 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117b37e-73af-477f-bd59-0050e0822d42 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:36.871640 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:36.914567 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117b37e-73af-477f-bd59-0050e0822d42 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:36.955755 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3944e47-34d5-4b26-9ca1-34e860e25684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:36.956425 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3944e47-34d5-4b26-9ca1-34e860e25684 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:36.956713 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3944e47-34d5-4b26-9ca1-34e860e25684 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:36.956993 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3944e47-34d5-4b26-9ca1-34e860e25684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:36.957826 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3944e47-34d5-4b26-9ca1-34e860e25684 None admin] RBAC: Adding query filter params (role.id=7bea6298af7e4980950949b024a1e103, scope.project.id=f2fc6165f0384fac8e876908e84085e2, user.id=19e53d16eadc49a4b82928e171892ff0) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:36.958148 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3944e47-34d5-4b26-9ca1-34e860e25684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:36.959783 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3944e47-34d5-4b26-9ca1-34e860e25684 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:36.970152 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 146/294] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:36 2022] GET /identity/v3/role_assignments?user.id=19e53d16eadc49a4b82928e171892ff0&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=7bea6298af7e4980950949b024a1e103 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:37.957106 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574981fa-b2c3-4466-8da8-776c28f8cb5a None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:37.958147 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574981fa-b2c3-4466-8da8-776c28f8cb5a None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:37.958648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574981fa-b2c3-4466-8da8-776c28f8cb5a None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:37.960607 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 149/295] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:37.966878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c418666-c77f-47b1-8399-12c58b1159bc None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:37.967751 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c418666-c77f-47b1-8399-12c58b1159bc None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:37.968228 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c418666-c77f-47b1-8399-12c58b1159bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:37.987646 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-9c418666-c77f-47b1-8399-12c58b1159bc None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:37.989186 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-9c418666-c77f-47b1-8399-12c58b1159bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:38.050442 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e022348-0b47-42c0-a63a-95fa9f08f7b5 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.050752 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e022348-0b47-42c0-a63a-95fa9f08f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.051004 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e022348-0b47-42c0-a63a-95fa9f08f7b5 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.052392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 150/296] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:38.059491 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c43f7-5374-4c25-a23a-bcf0b57ced29 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.059779 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c43f7-5374-4c25-a23a-bcf0b57ced29 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.060084 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c43f7-5374-4c25-a23a-bcf0b57ced29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.071171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 147/297] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:38.085787 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-835c43f7-5374-4c25-a23a-bcf0b57ced29 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:38.087476 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-835c43f7-5374-4c25-a23a-bcf0b57ced29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:38.096249 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c418666-c77f-47b1-8399-12c58b1159bc None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:38.152992 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:38.160859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 151/298] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:38.185096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c43f7-5374-4c25-a23a-bcf0b57ced29 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:38.214771 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c418666-c77f-47b1-8399-12c58b1159bc None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:38.264068 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef4356-bdf2-41e8-9410-b6cdd82c3cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:38.267243 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef4356-bdf2-41e8-9410-b6cdd82c3cd3 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.267535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef4356-bdf2-41e8-9410-b6cdd82c3cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.267810 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef4356-bdf2-41e8-9410-b6cdd82c3cd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.284870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef4356-bdf2-41e8-9410-b6cdd82c3cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-1eef4356-bdf2-41e8-9410-b6cdd82c3cd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:38.296157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:38.297134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:38.297909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:38.299467 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 148/299] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:38.304288 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef4356-bdf2-41e8-9410-b6cdd82c3cd3 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:38.310053 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c43f7-5374-4c25-a23a-bcf0b57ced29 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:38.311680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:38.348503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37629761-bd1b-4ea0-b980-89c3ff4fe632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:38.348828 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37629761-bd1b-4ea0-b980-89c3ff4fe632 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.349188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37629761-bd1b-4ea0-b980-89c3ff4fe632 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.349498 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37629761-bd1b-4ea0-b980-89c3ff4fe632 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.350934 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37629761-bd1b-4ea0-b980-89c3ff4fe632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:38.352457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37629761-bd1b-4ea0-b980-89c3ff4fe632 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:38.359780 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 152/300] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:38.360846 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37629761-bd1b-4ea0-b980-89c3ff4fe632 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:38.422430 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef4356-bdf2-41e8-9410-b6cdd82c3cd3 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:38.438044 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:38.461063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d63ed-6e40-42f2-8408-2d14c1c355e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:38.462088 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d63ed-6e40-42f2-8408-2d14c1c355e2 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.462655 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d63ed-6e40-42f2-8408-2d14c1c355e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.463193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d63ed-6e40-42f2-8408-2d14c1c355e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.464388 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d63ed-6e40-42f2-8408-2d14c1c355e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:38.464961 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d63ed-6e40-42f2-8408-2d14c1c355e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:38.466630 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d63ed-6e40-42f2-8408-2d14c1c355e2 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:38.476041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 149/301] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:38.476549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37629761-bd1b-4ea0-b980-89c3ff4fe632 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:38.483380 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d63ed-6e40-42f2-8408-2d14c1c355e2 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:38.530575 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85968a-80e7-4963-9c6c-5f94c3ce1714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:38.531831 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85968a-80e7-4963-9c6c-5f94c3ce1714 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.532532 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85968a-80e7-4963-9c6c-5f94c3ce1714 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.533054 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85968a-80e7-4963-9c6c-5f94c3ce1714 None admin] PATH_INFO: `/v3/groups` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.533990 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85968a-80e7-4963-9c6c-5f94c3ce1714 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:38.536110 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85968a-80e7-4963-9c6c-5f94c3ce1714 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:38.567165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 153/302] 10.222.0.98 () {60 vars in 1134 bytes} [Mon Jul 25 18:56:38 2022] POST /identity/v3/groups => generated 229 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:56:38.628598 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d63ed-6e40-42f2-8408-2d14c1c355e2 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:38.670689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73458d-f5dd-44e6-bf15-648b2d4cc8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:38.671749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73458d-f5dd-44e6-bf15-648b2d4cc8f7 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.672038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73458d-f5dd-44e6-bf15-648b2d4cc8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.672314 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73458d-f5dd-44e6-bf15-648b2d4cc8f7 None admin] PATH_INFO: `/v3/users/a0f03025726d46688c2ab5c977a7b971` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.680779 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982d072-b6cc-4af8-ae69-6fe2374ddb4d None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.682183 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982d072-b6cc-4af8-ae69-6fe2374ddb4d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.682673 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982d072-b6cc-4af8-ae69-6fe2374ddb4d None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.684316 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 154/303] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:38.685736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b699ff0-a036-45f8-ba1b-27e2807e9dac None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.686240 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b699ff0-a036-45f8-ba1b-27e2807e9dac None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.686745 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b699ff0-a036-45f8-ba1b-27e2807e9dac None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.688434 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 155/304] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:38.690092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73458d-f5dd-44e6-bf15-648b2d4cc8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f03025726d46688c2ab5c977a7b971)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:38.690815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bff854-6f41-4100-a49d-f9edb9c3affc None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.691366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bff854-6f41-4100-a49d-f9edb9c3affc None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.691622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73458d-f5dd-44e6-bf15-648b2d4cc8f7 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:38.692075 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bff854-6f41-4100-a49d-f9edb9c3affc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.693786 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 150/305] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:38 2022] GET /identity/v3/users/a0f03025726d46688c2ab5c977a7b971 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:38.695075 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b40bea-fd55-4c5d-a1d0-43b2bbe71456 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.695387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b40bea-fd55-4c5d-a1d0-43b2bbe71456 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.695665 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b40bea-fd55-4c5d-a1d0-43b2bbe71456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.716993 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-22bff854-6f41-4100-a49d-f9edb9c3affc None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:38.717496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-31b40bea-fd55-4c5d-a1d0-43b2bbe71456 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:38.718140 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-22bff854-6f41-4100-a49d-f9edb9c3affc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:38.718847 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-31b40bea-fd55-4c5d-a1d0-43b2bbe71456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:38.747386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:38.750929 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:38.798218 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 151/306] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:38.799703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b40bea-fd55-4c5d-a1d0-43b2bbe71456 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:38.817034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 156/307] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:38.824035 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bff854-6f41-4100-a49d-f9edb9c3affc None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:38.926772 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b40bea-fd55-4c5d-a1d0-43b2bbe71456 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:38.949082 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bff854-6f41-4100-a49d-f9edb9c3affc None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:38.969901 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd96fb-d31f-46b0-92ba-99c7f12ff109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:38.970541 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd96fb-d31f-46b0-92ba-99c7f12ff109 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:38.970770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd96fb-d31f-46b0-92ba-99c7f12ff109 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:38.971040 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd96fb-d31f-46b0-92ba-99c7f12ff109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:38.971925 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd96fb-d31f-46b0-92ba-99c7f12ff109 None admin] RBAC: Adding query filter params (role.id=d1fa8990af404eefaf52fee0dc7d1811, user.id=a0f03025726d46688c2ab5c977a7b971, scope.system=all) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:38.972240 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd96fb-d31f-46b0-92ba-99c7f12ff109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:38.974046 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd96fb-d31f-46b0-92ba-99c7f12ff109 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:38.991161 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 152/308] 10.222.0.98 () {56 vars in 1308 bytes} [Mon Jul 25 18:56:38 2022] GET /identity/v3/role_assignments?user.id=a0f03025726d46688c2ab5c977a7b971&scope.system=all&role.id=d1fa8990af404eefaf52fee0dc7d1811 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:38.991161 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd96fb-d31f-46b0-92ba-99c7f12ff109 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:39.003990 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2639d-81b4-4c81-9e42-c1c3ff9f8595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:39.004902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2639d-81b4-4c81-9e42-c1c3ff9f8595 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:39.005394 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2639d-81b4-4c81-9e42-c1c3ff9f8595 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:39.005729 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2639d-81b4-4c81-9e42-c1c3ff9f8595 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:39.020210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2639d-81b4-4c81-9e42-c1c3ff9f8595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:39.021327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-c3a2639d-81b4-4c81-9e42-c1c3ff9f8595 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:39.033078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:39.034136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:39.034916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:39.036028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 157/309] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:56:39.044215 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2639d-81b4-4c81-9e42-c1c3ff9f8595 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:39.069083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:39.117686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd96fb-d31f-46b0-92ba-99c7f12ff109 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:39.160217 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8627e-c91f-4b51-b3b3-4b3f5b37258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:39.161433 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8627e-c91f-4b51-b3b3-4b3f5b37258c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:39.161773 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8627e-c91f-4b51-b3b3-4b3f5b37258c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:39.162233 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8627e-c91f-4b51-b3b3-4b3f5b37258c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:39.181586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8627e-c91f-4b51-b3b3-4b3f5b37258c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:39.182957 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2639d-81b4-4c81-9e42-c1c3ff9f8595 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-dec8627e-c91f-4b51-b3b3-4b3f5b37258c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:39.191062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:39.192212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:39.193116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 153/310] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:39.201948 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8627e-c91f-4b51-b3b3-4b3f5b37258c None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:39.237866 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee4343-2cc4-4dbb-9d85-0c87426767c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:39.238459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee4343-2cc4-4dbb-9d85-0c87426767c9 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:39.238753 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee4343-2cc4-4dbb-9d85-0c87426767c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:39.239091 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee4343-2cc4-4dbb-9d85-0c87426767c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:39.240196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee4343-2cc4-4dbb-9d85-0c87426767c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:39.240533 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee4343-2cc4-4dbb-9d85-0c87426767c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:39.242870 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee4343-2cc4-4dbb-9d85-0c87426767c9 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:39.253646 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 158/311] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:39.259732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee4343-2cc4-4dbb-9d85-0c87426767c9 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:39.307306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:39.329874 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8627e-c91f-4b51-b3b3-4b3f5b37258c None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:39.367577 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:39.371706 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee4343-2cc4-4dbb-9d85-0c87426767c9 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:39.376253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6975-a0aa-41d3-b687-70c27d4a4089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:39.377117 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6975-a0aa-41d3-b687-70c27d4a4089 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:39.377551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6975-a0aa-41d3-b687-70c27d4a4089 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:39.377977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6975-a0aa-41d3-b687-70c27d4a4089 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:39.378931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c6975-a0aa-41d3-b687-70c27d4a4089 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:39.379496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c6975-a0aa-41d3-b687-70c27d4a4089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:39.381023 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c6975-a0aa-41d3-b687-70c27d4a4089 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:39.393052 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 154/312] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:39.404577 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6975-a0aa-41d3-b687-70c27d4a4089 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:39.412932 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9952a-5d64-41ca-b4c5-037200a67b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:39.413951 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9952a-5d64-41ca-b4c5-037200a67b4c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:39.414339 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9952a-5d64-41ca-b4c5-037200a67b4c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:39.414718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9952a-5d64-41ca-b4c5-037200a67b4c None admin] PATH_INFO: `/v3/users/e25b0221fd7246e8b9460b4f1fdf10b6` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:39.417148 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9952a-5d64-41ca-b4c5-037200a67b4c None admin] RBAC: Authorizing `identity:get_user(user_id=e25b0221fd7246e8b9460b4f1fdf10b6)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:39.419305 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9952a-5d64-41ca-b4c5-037200a67b4c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:39.422159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 159/313] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:39 2022] GET /identity/v3/users/e25b0221fd7246e8b9460b4f1fdf10b6 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:39.428046 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9952a-5d64-41ca-b4c5-037200a67b4c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:39.523929 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6975-a0aa-41d3-b687-70c27d4a4089 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:39.536333 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9952a-5d64-41ca-b4c5-037200a67b4c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:39.561630 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30463ab-3154-48b4-92bb-ceecd29cf4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:39.562507 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30463ab-3154-48b4-92bb-ceecd29cf4b4 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:39.562789 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30463ab-3154-48b4-92bb-ceecd29cf4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:39.563067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30463ab-3154-48b4-92bb-ceecd29cf4b4 None admin] PATH_INFO: `/v3/users/7f85a477eca34ea1b2826a27d9b0a0ac` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:39.564482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30463ab-3154-48b4-92bb-ceecd29cf4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=7f85a477eca34ea1b2826a27d9b0a0ac)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:39.566030 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30463ab-3154-48b4-92bb-ceecd29cf4b4 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:39.568299 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 155/314] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:39 2022] GET /identity/v3/users/7f85a477eca34ea1b2826a27d9b0a0ac => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:39.573991 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30463ab-3154-48b4-92bb-ceecd29cf4b4 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:39.582297 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b74ac-c28c-4752-aa45-6d8417f7c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:39.583890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b74ac-c28c-4752-aa45-6d8417f7c271 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:39.584280 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b74ac-c28c-4752-aa45-6d8417f7c271 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:39.584654 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b74ac-c28c-4752-aa45-6d8417f7c271 None admin] PATH_INFO: `/v3/system/users/e25b0221fd7246e8b9460b4f1fdf10b6/roles/7bea6298af7e4980950949b024a1e103` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:39.586690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b74ac-c28c-4752-aa45-6d8417f7c271 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e25b0221fd7246e8b9460b4f1fdf10b6, role_id=7bea6298af7e4980950949b024a1e103)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:39.588821 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b74ac-c28c-4752-aa45-6d8417f7c271 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:39.598500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:39.603235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 160/315] 10.222.0.98 () {58 vars in 1334 bytes} [Mon Jul 25 18:56:39 2022] PUT /identity/v3/system/users/e25b0221fd7246e8b9460b4f1fdf10b6/roles/7bea6298af7e4980950949b024a1e103 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 18:56:39.710389 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30463ab-3154-48b4-92bb-ceecd29cf4b4 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:39.747874 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d573a0-8ecb-41bb-be88-0e6abd1300ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:39.748538 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d573a0-8ecb-41bb-be88-0e6abd1300ce None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:39.748826 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d573a0-8ecb-41bb-be88-0e6abd1300ce None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:39.749102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d573a0-8ecb-41bb-be88-0e6abd1300ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:39.834436 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d573a0-8ecb-41bb-be88-0e6abd1300ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:39.835855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d573a0-8ecb-41bb-be88-0e6abd1300ce None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:39.854465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:39.948748 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 156/316] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:39.956269 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b74ac-c28c-4752-aa45-6d8417f7c271 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:39.971699 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:40.061489 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b74ac-c28c-4752-aa45-6d8417f7c271 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:40.096330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d03f2-0be7-4752-8014-c9c25bc1a5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:40.097145 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d03f2-0be7-4752-8014-c9c25bc1a5f1 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:40.097431 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d03f2-0be7-4752-8014-c9c25bc1a5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:40.097704 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d03f2-0be7-4752-8014-c9c25bc1a5f1 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:40.098868 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d03f2-0be7-4752-8014-c9c25bc1a5f1 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:40.100361 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d03f2-0be7-4752-8014-c9c25bc1a5f1 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:40.102332 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 161/317] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:39 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:40.108762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d573a0-8ecb-41bb-be88-0e6abd1300ce None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:40.218877 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d573a0-8ecb-41bb-be88-0e6abd1300ce None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:40.241840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:40.261389 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44575185-998d-4e8c-9a4a-a970195e1f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:40.262072 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44575185-998d-4e8c-9a4a-a970195e1f1c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:40.262356 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44575185-998d-4e8c-9a4a-a970195e1f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:40.262700 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44575185-998d-4e8c-9a4a-a970195e1f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:40.263591 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44575185-998d-4e8c-9a4a-a970195e1f1c None admin] RBAC: Adding query filter params (role.id=d1fa8990af404eefaf52fee0dc7d1811, scope.project.id=f2fc6165f0384fac8e876908e84085e2, user.id=7f85a477eca34ea1b2826a27d9b0a0ac) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:40.263916 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44575185-998d-4e8c-9a4a-a970195e1f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:40.265382 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44575185-998d-4e8c-9a4a-a970195e1f1c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:40.272544 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 157/318] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:56:40 2022] GET /identity/v3/role_assignments?user.id=7f85a477eca34ea1b2826a27d9b0a0ac&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=d1fa8990af404eefaf52fee0dc7d1811 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:40.943737 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa12a5-b9b4-4ca3-bd98-ef392ed5e0d8 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:40.944106 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa12a5-b9b4-4ca3-bd98-ef392ed5e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:40.944321 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa12a5-b9b4-4ca3-bd98-ef392ed5e0d8 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:40.945817 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 162/319] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:40.951584 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b5ed-6e2d-407f-b6c3-9e3a7063a7c9 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:40.951875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b5ed-6e2d-407f-b6c3-9e3a7063a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:40.952151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b5ed-6e2d-407f-b6c3-9e3a7063a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:40.971578 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-4b97b5ed-6e2d-407f-b6c3-9e3a7063a7c9 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:40.972759 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-4b97b5ed-6e2d-407f-b6c3-9e3a7063a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:41.045179 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 158/320] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:41.068744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa12a5-b9b4-4ca3-bd98-ef392ed5e0d8 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:41.166331 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:41.188129 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa12a5-b9b4-4ca3-bd98-ef392ed5e0d8 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:41.222962 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417717b-8825-40fb-8009-6539ab4849f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:41.223707 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417717b-8825-40fb-8009-6539ab4849f9 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:41.223997 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417717b-8825-40fb-8009-6539ab4849f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:41.224276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417717b-8825-40fb-8009-6539ab4849f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:41.225446 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417717b-8825-40fb-8009-6539ab4849f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:41.226933 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417717b-8825-40fb-8009-6539ab4849f9 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:41.229490 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 163/321] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:56:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:41.235061 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97b5ed-6e2d-407f-b6c3-9e3a7063a7c9 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:41.341130 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97b5ed-6e2d-407f-b6c3-9e3a7063a7c9 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:41.352575 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:41.377973 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aeaa8-d050-460c-b8c2-d099bc074603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:41.378641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aeaa8-d050-460c-b8c2-d099bc074603 None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:41.378927 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aeaa8-d050-460c-b8c2-d099bc074603 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:41.379234 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aeaa8-d050-460c-b8c2-d099bc074603 None admin] PATH_INFO: `/v3/groups` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:41.379925 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3aeaa8-d050-460c-b8c2-d099bc074603 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:41.381367 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3aeaa8-d050-460c-b8c2-d099bc074603 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:41.398778 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811edbb-08c2-45f0-9a10-e363a2b7bbb4 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:41.399053 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811edbb-08c2-45f0-9a10-e363a2b7bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:41.399379 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811edbb-08c2-45f0-9a10-e363a2b7bbb4 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:41.401770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 164/322] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:41.407117 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c0e2-24f0-436f-b514-fe81535fc96f None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:41.407319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 159/323] 10.222.0.98 () {60 vars in 1134 bytes} [Mon Jul 25 18:56:41 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:56:41.407661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c0e2-24f0-436f-b514-fe81535fc96f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:41.408006 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c0e2-24f0-436f-b514-fe81535fc96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:41.427708 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-0b76c0e2-24f0-436f-b514-fe81535fc96f None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:41.428964 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-0b76c0e2-24f0-436f-b514-fe81535fc96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:41.505106 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 165/324] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:41.529749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aeaa8-d050-460c-b8c2-d099bc074603 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:41.642252 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aeaa8-d050-460c-b8c2-d099bc074603 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:41.679407 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12554cf-6d11-48d1-ad93-2d544e5273dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:41.680224 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12554cf-6d11-48d1-ad93-2d544e5273dd None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:41.680512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12554cf-6d11-48d1-ad93-2d544e5273dd None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:41.680793 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12554cf-6d11-48d1-ad93-2d544e5273dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:41.698452 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12554cf-6d11-48d1-ad93-2d544e5273dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-d12554cf-6d11-48d1-ad93-2d544e5273dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:41.706306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:41.707287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:41.708092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 160/325] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:41.716308 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c0e2-24f0-436f-b514-fe81535fc96f None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:41.802472 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:41.827050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c0e2-24f0-436f-b514-fe81535fc96f None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:41.868336 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e9fa7-7e11-4ba2-b969-59f33030d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:41.869886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9fa7-7e11-4ba2-b969-59f33030d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:41.870111 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9fa7-7e11-4ba2-b969-59f33030d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:41.870401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9fa7-7e11-4ba2-b969-59f33030d7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:41.871230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e9fa7-7e11-4ba2-b969-59f33030d7e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:41.871550 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e9fa7-7e11-4ba2-b969-59f33030d7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:41.873028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e9fa7-7e11-4ba2-b969-59f33030d7e3 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:41.885410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 166/326] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:41.890739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12554cf-6d11-48d1-ad93-2d544e5273dd None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:41.929000 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:42.005022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12554cf-6d11-48d1-ad93-2d544e5273dd None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:42.030889 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aefad5-65e6-4c5d-bd6b-75e282a38e23 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:42.031251 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aefad5-65e6-4c5d-bd6b-75e282a38e23 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:42.031476 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aefad5-65e6-4c5d-bd6b-75e282a38e23 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:42.032964 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 167/327] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:42.038322 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb5ebf-93e0-4e0e-bb5b-2eb8d8f2f264 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:42.038890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb5ebf-93e0-4e0e-bb5b-2eb8d8f2f264 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:42.039426 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb5ebf-93e0-4e0e-bb5b-2eb8d8f2f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:42.045877 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859f23-e32e-457c-81c6-3abe8219d080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:42.046752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859f23-e32e-457c-81c6-3abe8219d080 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:42.047217 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859f23-e32e-457c-81c6-3abe8219d080 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:42.047518 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859f23-e32e-457c-81c6-3abe8219d080 None admin] PATH_INFO: `/v3/users/a0f03025726d46688c2ab5c977a7b971` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:42.049591 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859f23-e32e-457c-81c6-3abe8219d080 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f03025726d46688c2ab5c977a7b971)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:42.051057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859f23-e32e-457c-81c6-3abe8219d080 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:42.053072 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 161/328] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:41 2022] GET /identity/v3/users/a0f03025726d46688c2ab5c977a7b971 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:42.058560 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859f23-e32e-457c-81c6-3abe8219d080 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:42.061694 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-ffdb5ebf-93e0-4e0e-bb5b-2eb8d8f2f264 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:42.063278 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-ffdb5ebf-93e0-4e0e-bb5b-2eb8d8f2f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:42.141029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 168/329] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:56:42.169112 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb5ebf-93e0-4e0e-bb5b-2eb8d8f2f264 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:42.180637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:42.186267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859f23-e32e-457c-81c6-3abe8219d080 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:42.232449 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce1797-7eb1-48ff-a8c4-87aaba20aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:42.233705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1797-7eb1-48ff-a8c4-87aaba20aa51 None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:42.234205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1797-7eb1-48ff-a8c4-87aaba20aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:42.234687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1797-7eb1-48ff-a8c4-87aaba20aa51 None admin] PATH_INFO: `/v3/system/users/a0f03025726d46688c2ab5c977a7b971/roles/d1fa8990af404eefaf52fee0dc7d1811` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:42.237050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce1797-7eb1-48ff-a8c4-87aaba20aa51 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a0f03025726d46688c2ab5c977a7b971, role_id=d1fa8990af404eefaf52fee0dc7d1811)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:42.239530 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce1797-7eb1-48ff-a8c4-87aaba20aa51 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:42.255166 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 162/330] 10.222.0.98 () {58 vars in 1334 bytes} [Mon Jul 25 18:56:42 2022] PUT /identity/v3/system/users/a0f03025726d46688c2ab5c977a7b971/roles/d1fa8990af404eefaf52fee0dc7d1811 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 18:56:42.272728 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:42.316299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb5ebf-93e0-4e0e-bb5b-2eb8d8f2f264 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:42.362293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5d986-d6cc-4c1b-beca-c6bb36e59386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:42.363109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d986-d6cc-4c1b-beca-c6bb36e59386 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:42.363429 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d986-d6cc-4c1b-beca-c6bb36e59386 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:42.363711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d986-d6cc-4c1b-beca-c6bb36e59386 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:42.378643 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5d986-d6cc-4c1b-beca-c6bb36e59386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-aea5d986-d6cc-4c1b-beca-c6bb36e59386 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:42.388114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:42.389099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:42.390374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 169/331] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:56:42.398176 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce1797-7eb1-48ff-a8c4-87aaba20aa51 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:42.528358 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce1797-7eb1-48ff-a8c4-87aaba20aa51 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:42.565967 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b9ee7-9ca2-411f-b9ad-7a08850d4240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:42.567087 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b9ee7-9ca2-411f-b9ad-7a08850d4240 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:42.567640 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b9ee7-9ca2-411f-b9ad-7a08850d4240 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:42.568118 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b9ee7-9ca2-411f-b9ad-7a08850d4240 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:42.569078 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b9ee7-9ca2-411f-b9ad-7a08850d4240 None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:42.569594 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b9ee7-9ca2-411f-b9ad-7a08850d4240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:42.571291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b9ee7-9ca2-411f-b9ad-7a08850d4240 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:42.585831 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 163/332] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:42.587649 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5d986-d6cc-4c1b-beca-c6bb36e59386 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:42.697260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5d986-d6cc-4c1b-beca-c6bb36e59386 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:42.728472 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:42.736648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb382154-6afe-4cc9-b629-04bc8eb3285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:42.737813 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb382154-6afe-4cc9-b629-04bc8eb3285f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:42.738307 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb382154-6afe-4cc9-b629-04bc8eb3285f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:42.738786 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb382154-6afe-4cc9-b629-04bc8eb3285f None admin] PATH_INFO: `/v3/users/e25b0221fd7246e8b9460b4f1fdf10b6` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:42.740239 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb382154-6afe-4cc9-b629-04bc8eb3285f None admin] RBAC: Authorizing `identity:get_user(user_id=e25b0221fd7246e8b9460b4f1fdf10b6)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:42.741923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb382154-6afe-4cc9-b629-04bc8eb3285f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:42.744455 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 170/333] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:42 2022] GET /identity/v3/users/e25b0221fd7246e8b9460b4f1fdf10b6 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:42.750597 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b9ee7-9ca2-411f-b9ad-7a08850d4240 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:42.781006 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:42.873422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b9ee7-9ca2-411f-b9ad-7a08850d4240 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:42.918981 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d8b2-343e-4978-94a3-008bdf4bbc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:42.920043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d8b2-343e-4978-94a3-008bdf4bbc6c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:42.920549 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d8b2-343e-4978-94a3-008bdf4bbc6c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:42.921038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d8b2-343e-4978-94a3-008bdf4bbc6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:42.922076 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d8b2-343e-4978-94a3-008bdf4bbc6c None admin] RBAC: Adding query filter params (role.id=7bea6298af7e4980950949b024a1e103, user.id=e25b0221fd7246e8b9460b4f1fdf10b6, scope.system=all) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:42.922599 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d8b2-343e-4978-94a3-008bdf4bbc6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:42.924310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d8b2-343e-4978-94a3-008bdf4bbc6c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:42.942921 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 164/334] 10.222.0.98 () {56 vars in 1308 bytes} [Mon Jul 25 18:56:42 2022] GET /identity/v3/role_assignments?user.id=e25b0221fd7246e8b9460b4f1fdf10b6&scope.system=all&role.id=7bea6298af7e4980950949b024a1e103 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:44.387793 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc4dd-987a-4060-ba8d-ae6a50b280ca None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:44.388330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc4dd-987a-4060-ba8d-ae6a50b280ca None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:44.388330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc4dd-987a-4060-ba8d-ae6a50b280ca None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:44.389948 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 171/335] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:44.402094 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207911ae-a9f3-44fc-9a77-0c4a36914167 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:44.402616 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207911ae-a9f3-44fc-9a77-0c4a36914167 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:44.402699 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207911ae-a9f3-44fc-9a77-0c4a36914167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:44.426111 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-207911ae-a9f3-44fc-9a77-0c4a36914167 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:44.427339 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-207911ae-a9f3-44fc-9a77-0c4a36914167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:44.505995 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 165/336] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:44.545707 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bc4dd-987a-4060-ba8d-ae6a50b280ca None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:44.669749 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bc4dd-987a-4060-ba8d-ae6a50b280ca None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:44.720351 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc835e-375a-4ef1-ab6d-8a476c5425a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:44.721179 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc835e-375a-4ef1-ab6d-8a476c5425a5 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:44.721468 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc835e-375a-4ef1-ab6d-8a476c5425a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:44.721750 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc835e-375a-4ef1-ab6d-8a476c5425a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:44.741884 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc835e-375a-4ef1-ab6d-8a476c5425a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-b9dc835e-375a-4ef1-ab6d-8a476c5425a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:44.750260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:44.751264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:44.752057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 172/337] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:44.758704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207911ae-a9f3-44fc-9a77-0c4a36914167 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:44.778369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:44.876599 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46469ec8-4f1a-476a-9274-a35a18e1fd28 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:44.876891 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46469ec8-4f1a-476a-9274-a35a18e1fd28 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:44.877177 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46469ec8-4f1a-476a-9274-a35a18e1fd28 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:44.878552 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 173/338] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:44.885277 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78545cec-3128-4cff-8a9c-0fb1e21d8759 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:44.885567 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78545cec-3128-4cff-8a9c-0fb1e21d8759 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:44.885852 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78545cec-3128-4cff-8a9c-0fb1e21d8759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:44.891915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207911ae-a9f3-44fc-9a77-0c4a36914167 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:44.918509 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-78545cec-3128-4cff-8a9c-0fb1e21d8759 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:44.921018 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-78545cec-3128-4cff-8a9c-0fb1e21d8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:44.942304 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380758-ffa8-4754-a40b-440ce6dc51e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:44.943359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380758-ffa8-4754-a40b-440ce6dc51e1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:44.943845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380758-ffa8-4754-a40b-440ce6dc51e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:44.944338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380758-ffa8-4754-a40b-440ce6dc51e1 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:44.945302 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63380758-ffa8-4754-a40b-440ce6dc51e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:44.945823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63380758-ffa8-4754-a40b-440ce6dc51e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:44.947486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63380758-ffa8-4754-a40b-440ce6dc51e1 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:44.956865 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 166/339] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:44.966239 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380758-ffa8-4754-a40b-440ce6dc51e1 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:45.059866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:45.075404 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:45.106748 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380758-ffa8-4754-a40b-440ce6dc51e1 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:45.120864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 174/340] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:56:45.162940 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b7c88-29b0-4466-bf41-12d3c59d7082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:45.164070 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7c88-29b0-4466-bf41-12d3c59d7082 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:45.164562 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7c88-29b0-4466-bf41-12d3c59d7082 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:45.165041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7c88-29b0-4466-bf41-12d3c59d7082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:45.172723 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78545cec-3128-4cff-8a9c-0fb1e21d8759 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:45.332185 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b7c88-29b0-4466-bf41-12d3c59d7082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:45.333864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b7c88-29b0-4466-bf41-12d3c59d7082 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:45.354476 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78545cec-3128-4cff-8a9c-0fb1e21d8759 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:45.425484 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06ea74-f4ef-417d-b2e5-9afabd49fec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:45.426347 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06ea74-f4ef-417d-b2e5-9afabd49fec8 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:45.426702 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06ea74-f4ef-417d-b2e5-9afabd49fec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:45.426979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06ea74-f4ef-417d-b2e5-9afabd49fec8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:45.450210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06ea74-f4ef-417d-b2e5-9afabd49fec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:45.460489 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-9d06ea74-f4ef-417d-b2e5-9afabd49fec8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:45.464620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:45.465535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:45.466588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:45.470399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 175/341] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:45.472082 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98132fc-4a92-4330-9719-6fea14924208 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:45.472603 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98132fc-4a92-4330-9719-6fea14924208 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:45.473100 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98132fc-4a92-4330-9719-6fea14924208 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:45.474652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 176/342] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:45.475579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98132fc-4a92-4330-9719-6fea14924208 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:45.497603 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 167/343] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:45.499491 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99590220-cd7b-48b4-b9e5-b89b7f00ae1a None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:45.499831 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99590220-cd7b-48b4-b9e5-b89b7f00ae1a None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:45.500116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99590220-cd7b-48b4-b9e5-b89b7f00ae1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:45.520133 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-99590220-cd7b-48b4-b9e5-b89b7f00ae1a None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:45.521326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-99590220-cd7b-48b4-b9e5-b89b7f00ae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:45.595527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 168/344] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:45.596697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99590220-cd7b-48b4-b9e5-b89b7f00ae1a None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:45.596883 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:45.709504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98132fc-4a92-4330-9719-6fea14924208 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:45.713835 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99590220-cd7b-48b4-b9e5-b89b7f00ae1a None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:45.717124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:45.754150 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc9015-8d89-4f07-a546-44c72ac283aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:45.754441 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b46cf-b6d1-4728-a588-9ea4f85f4afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:45.755144 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b46cf-b6d1-4728-a588-9ea4f85f4afc None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:45.755435 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b46cf-b6d1-4728-a588-9ea4f85f4afc None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:45.755716 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b46cf-b6d1-4728-a588-9ea4f85f4afc None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:45.755888 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc9015-8d89-4f07-a546-44c72ac283aa None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:45.756298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc9015-8d89-4f07-a546-44c72ac283aa None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:45.756465 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b46cf-b6d1-4728-a588-9ea4f85f4afc None admin] RBAC: Adding query filter params (name=member) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:45.756780 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b46cf-b6d1-4728-a588-9ea4f85f4afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:45.756992 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc9015-8d89-4f07-a546-44c72ac283aa None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:45.758450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b46cf-b6d1-4728-a588-9ea4f85f4afc None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:45.758774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc9015-8d89-4f07-a546-44c72ac283aa None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:45.761883 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc9015-8d89-4f07-a546-44c72ac283aa None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:45.764668 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 169/345] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:45 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:45.765609 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc9015-8d89-4f07-a546-44c72ac283aa None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:45.768912 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 177/346] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:45.770410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b46cf-b6d1-4728-a588-9ea4f85f4afc None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:45.904872 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc9015-8d89-4f07-a546-44c72ac283aa None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:45.982115 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6b143-78cc-4051-8100-1a991e613c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:45.982849 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6b143-78cc-4051-8100-1a991e613c53 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:45.983149 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6b143-78cc-4051-8100-1a991e613c53 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:45.983429 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6b143-78cc-4051-8100-1a991e613c53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:45.999252 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6b143-78cc-4051-8100-1a991e613c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-7bf6b143-78cc-4051-8100-1a991e613c53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:46.007739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:46.008704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:46.010730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 170/347] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:46.012031 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6b143-78cc-4051-8100-1a991e613c53 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:46.058902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:46.073143 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b46cf-b6d1-4728-a588-9ea4f85f4afc None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:46.086326 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:46.122601 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c20ee-f697-49c6-a4f9-2747f4d6bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:46.123501 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c20ee-f697-49c6-a4f9-2747f4d6bb4d None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.123790 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c20ee-f697-49c6-a4f9-2747f4d6bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.124066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c20ee-f697-49c6-a4f9-2747f4d6bb4d None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.134819 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c20ee-f697-49c6-a4f9-2747f4d6bb4d None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:46.136271 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c20ee-f697-49c6-a4f9-2747f4d6bb4d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:46.138320 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 178/348] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:45 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:46.139118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c20ee-f697-49c6-a4f9-2747f4d6bb4d None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:46.155452 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6b143-78cc-4051-8100-1a991e613c53 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:46.205793 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9273e-131b-4dc4-b980-3d90980632eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:46.206454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9273e-131b-4dc4-b980-3d90980632eb None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.206739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9273e-131b-4dc4-b980-3d90980632eb None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.207022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9273e-131b-4dc4-b980-3d90980632eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.269128 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c20ee-f697-49c6-a4f9-2747f4d6bb4d None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:46.303721 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9273e-131b-4dc4-b980-3d90980632eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:46.306269 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9273e-131b-4dc4-b980-3d90980632eb None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:46.312280 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b4dac-1d41-4493-aa42-17af779a278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:46.312955 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4dac-1d41-4493-aa42-17af779a278a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.313241 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4dac-1d41-4493-aa42-17af779a278a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.313518 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4dac-1d41-4493-aa42-17af779a278a None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.314271 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b4dac-1d41-4493-aa42-17af779a278a None admin] RBAC: Adding query filter params (name=member) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:46.314582 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b4dac-1d41-4493-aa42-17af779a278a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:46.316102 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b4dac-1d41-4493-aa42-17af779a278a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:46.329850 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 179/349] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:46.331426 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db95e8-e197-4286-b30e-eee9fbaf3b07 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.331722 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db95e8-e197-4286-b30e-eee9fbaf3b07 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.332005 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db95e8-e197-4286-b30e-eee9fbaf3b07 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.333228 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 180/350] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:46.334011 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db95e8-e197-4286-b30e-eee9fbaf3b07 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:46.359230 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:46.392468 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:46.454797 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 171/351] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:46.456722 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847a15-3f10-47f0-ac41-d16e75eb8233 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.457219 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847a15-3f10-47f0-ac41-d16e75eb8233 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.457694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847a15-3f10-47f0-ac41-d16e75eb8233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.476271 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db95e8-e197-4286-b30e-eee9fbaf3b07 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:46.478284 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-12847a15-3f10-47f0-ac41-d16e75eb8233 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:46.480031 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-12847a15-3f10-47f0-ac41-d16e75eb8233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:46.516104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85d973-62d4-4b2a-921f-e322e3a6f0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:46.516783 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85d973-62d4-4b2a-921f-e322e3a6f0b4 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.517088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85d973-62d4-4b2a-921f-e322e3a6f0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.517465 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85d973-62d4-4b2a-921f-e322e3a6f0b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.518319 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85d973-62d4-4b2a-921f-e322e3a6f0b4 None admin] RBAC: Adding query filter params (group.id=46db6b0d527a438ca10ea2fcd8fad39c, role.id=65e129db80a94ccfba2808ee5768976e, scope.project.id=717b1694b0dd4e97b07cf61aeee56400) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:46.518641 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85d973-62d4-4b2a-921f-e322e3a6f0b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:46.520929 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85d973-62d4-4b2a-921f-e322e3a6f0b4 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:46.527565 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 181/352] 10.222.0.98 () {56 vars in 1376 bytes} [Mon Jul 25 18:56:46 2022] GET /identity/v3/role_assignments?group.id=46db6b0d527a438ca10ea2fcd8fad39c&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=65e129db80a94ccfba2808ee5768976e => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:46.531385 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85d973-62d4-4b2a-921f-e322e3a6f0b4 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:46.565697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 172/353] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:46.567063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12847a15-3f10-47f0-ac41-d16e75eb8233 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:46.640002 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:46.649319 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:46.654185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85d973-62d4-4b2a-921f-e322e3a6f0b4 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:46.689063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12847a15-3f10-47f0-ac41-d16e75eb8233 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:46.694411 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e744ee3-a2d4-42b5-850c-c6b9184edcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:46.695156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e744ee3-a2d4-42b5-850c-c6b9184edcb4 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.695463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e744ee3-a2d4-42b5-850c-c6b9184edcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.695745 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e744ee3-a2d4-42b5-850c-c6b9184edcb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.731871 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a02f3c-c0de-4bd6-ac43-965b24adad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:46.733195 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a02f3c-c0de-4bd6-ac43-965b24adad27 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.733729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a02f3c-c0de-4bd6-ac43-965b24adad27 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.734222 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a02f3c-c0de-4bd6-ac43-965b24adad27 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.736112 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a02f3c-c0de-4bd6-ac43-965b24adad27 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:46.738005 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a02f3c-c0de-4bd6-ac43-965b24adad27 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:46.740528 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 173/354] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:46 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:46.742212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cfe6a-a25d-4659-a2c6-6a3c57f6ddaa None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.742736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cfe6a-a25d-4659-a2c6-6a3c57f6ddaa None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.743336 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cfe6a-a25d-4659-a2c6-6a3c57f6ddaa None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.745791 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 174/355] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:46.746817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cfe6a-a25d-4659-a2c6-6a3c57f6ddaa None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:46.780041 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e744ee3-a2d4-42b5-850c-c6b9184edcb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:46.781513 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e744ee3-a2d4-42b5-850c-c6b9184edcb4 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:46.865087 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cfe6a-a25d-4659-a2c6-6a3c57f6ddaa None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:46.894449 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:46.901130 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 182/356] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:46.906985 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e744ee3-a2d4-42b5-850c-c6b9184edcb4 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:46.910127 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:46.917792 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb1e8a-e4ab-4f46-b207-70c080be9cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:46.919603 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb1e8a-e4ab-4f46-b207-70c080be9cf2 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.920005 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb1e8a-e4ab-4f46-b207-70c080be9cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.920391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb1e8a-e4ab-4f46-b207-70c080be9cf2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.937814 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb1e8a-e4ab-4f46-b207-70c080be9cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-c7bb1e8a-e4ab-4f46-b207-70c080be9cf2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:46.950359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:46.951320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 18:56:46.952107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:46.955007 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 175/357] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:46.956418 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b45a0-6419-4ae3-a049-2b97100584fe None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:46.956716 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b45a0-6419-4ae3-a049-2b97100584fe None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:46.956996 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b45a0-6419-4ae3-a049-2b97100584fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:46.979543 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-361b45a0-6419-4ae3-a049-2b97100584fe None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:46.980861 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-361b45a0-6419-4ae3-a049-2b97100584fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:47.036941 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e744ee3-a2d4-42b5-850c-c6b9184edcb4 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:47.081528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aac1e-30fe-48b9-90d8-6196d3307341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:47.082395 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aac1e-30fe-48b9-90d8-6196d3307341 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:47.082683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aac1e-30fe-48b9-90d8-6196d3307341 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:47.082850 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 176/358] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:47.083720 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b45a0-6419-4ae3-a049-2b97100584fe None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:47.084510 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aac1e-30fe-48b9-90d8-6196d3307341 None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:47.085801 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aac1e-30fe-48b9-90d8-6196d3307341 None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:47.088288 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aac1e-30fe-48b9-90d8-6196d3307341 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:47.090027 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 183/359] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:46 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:47.090855 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aac1e-30fe-48b9-90d8-6196d3307341 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:47.180041 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:47.221230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aac1e-30fe-48b9-90d8-6196d3307341 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:47.237413 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b45a0-6419-4ae3-a049-2b97100584fe None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:47.263598 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33649f7-53ca-46a3-8f4e-fbe7ea72bc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:47.264282 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33649f7-53ca-46a3-8f4e-fbe7ea72bc7b None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:47.264570 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33649f7-53ca-46a3-8f4e-fbe7ea72bc7b None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:47.264870 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33649f7-53ca-46a3-8f4e-fbe7ea72bc7b None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:47.265206 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:47.266075 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33649f7-53ca-46a3-8f4e-fbe7ea72bc7b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:47.266395 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33649f7-53ca-46a3-8f4e-fbe7ea72bc7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:47.268247 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33649f7-53ca-46a3-8f4e-fbe7ea72bc7b None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:47.280975 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 184/360] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:47.281821 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33649f7-53ca-46a3-8f4e-fbe7ea72bc7b None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:47.291401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40858ec5-0a13-43b5-916e-9c4f0bf0d857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:47.292986 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40858ec5-0a13-43b5-916e-9c4f0bf0d857 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:47.293449 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40858ec5-0a13-43b5-916e-9c4f0bf0d857 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:47.294248 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40858ec5-0a13-43b5-916e-9c4f0bf0d857 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:47.295983 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40858ec5-0a13-43b5-916e-9c4f0bf0d857 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:47.297649 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40858ec5-0a13-43b5-916e-9c4f0bf0d857 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:47.299578 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 177/361] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:47 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:47.300289 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40858ec5-0a13-43b5-916e-9c4f0bf0d857 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:47.418096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33649f7-53ca-46a3-8f4e-fbe7ea72bc7b None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:47.432903 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40858ec5-0a13-43b5-916e-9c4f0bf0d857 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:47.457532 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:47.465027 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c63963-d73c-4dd4-b047-300aab023ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:47.465335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c63963-d73c-4dd4-b047-300aab023ca6 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:47.465622 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c63963-d73c-4dd4-b047-300aab023ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:47.465896 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c63963-d73c-4dd4-b047-300aab023ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:47.467457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c63963-d73c-4dd4-b047-300aab023ca6 None admin] RBAC: Adding query filter params (group.id=46db6b0d527a438ca10ea2fcd8fad39c, role.id=7bea6298af7e4980950949b024a1e103, scope.project.id=717b1694b0dd4e97b07cf61aeee56400) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:47.467457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c63963-d73c-4dd4-b047-300aab023ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:47.471106 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c63963-d73c-4dd4-b047-300aab023ca6 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:47.475001 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 185/362] 10.222.0.98 () {56 vars in 1376 bytes} [Mon Jul 25 18:56:47 2022] GET /identity/v3/role_assignments?group.id=46db6b0d527a438ca10ea2fcd8fad39c&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=7bea6298af7e4980950949b024a1e103 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:47.476400 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b993c0-4e39-4117-8e91-059c81ed452a None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:47.476923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b993c0-4e39-4117-8e91-059c81ed452a None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:47.476995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b993c0-4e39-4117-8e91-059c81ed452a None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:47.477240 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee1a87-0e9e-4b29-af31-660531c47fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:47.478612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee1a87-0e9e-4b29-af31-660531c47fbe None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:47.479091 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 186/363] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:47.479216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee1a87-0e9e-4b29-af31-660531c47fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:47.479216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee1a87-0e9e-4b29-af31-660531c47fbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:47.480421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b993c0-4e39-4117-8e91-059c81ed452a None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:47.499475 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee1a87-0e9e-4b29-af31-660531c47fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-94ee1a87-0e9e-4b29-af31-660531c47fbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:47.507984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:47.508915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:47.510423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:47.511594 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 178/364] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:47.512215 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee1a87-0e9e-4b29-af31-660531c47fbe None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:47.582499 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:47.615383 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b993c0-4e39-4117-8e91-059c81ed452a None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:47.656163 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee1a87-0e9e-4b29-af31-660531c47fbe None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:47.667170 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf410c-e77c-4d1d-9f79-ace7f1761c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:47.668088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf410c-e77c-4d1d-9f79-ace7f1761c0f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:47.668421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf410c-e77c-4d1d-9f79-ace7f1761c0f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:47.668696 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf410c-e77c-4d1d-9f79-ace7f1761c0f None admin] PATH_INFO: `/v3/users/a0f03025726d46688c2ab5c977a7b971` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:47.670041 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf410c-e77c-4d1d-9f79-ace7f1761c0f None admin] RBAC: Authorizing `identity:get_user(user_id=a0f03025726d46688c2ab5c977a7b971)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:47.671660 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf410c-e77c-4d1d-9f79-ace7f1761c0f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:47.673499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 187/365] 10.222.0.98 () {56 vars in 1177 bytes} [Mon Jul 25 18:56:47 2022] GET /identity/v3/users/a0f03025726d46688c2ab5c977a7b971 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:47.681143 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff97c9-3bc8-42b7-b724-34dceddb3f63 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:47.681465 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff97c9-3bc8-42b7-b724-34dceddb3f63 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:47.681741 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff97c9-3bc8-42b7-b724-34dceddb3f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:47.700785 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e011-d1cc-410c-9f07-c4f23a48f0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:47.702203 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e011-d1cc-410c-9f07-c4f23a48f0bd None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:47.702642 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e011-d1cc-410c-9f07-c4f23a48f0bd None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:47.702926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e011-d1cc-410c-9f07-c4f23a48f0bd None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:47.704295 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e011-d1cc-410c-9f07-c4f23a48f0bd None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:47.705746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e011-d1cc-410c-9f07-c4f23a48f0bd None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:47.707226 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-8bff97c9-3bc8-42b7-b724-34dceddb3f63 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:47.709046 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-8bff97c9-3bc8-42b7-b724-34dceddb3f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:47.711234 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 179/366] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:47 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:47.713075 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e011-d1cc-410c-9f07-c4f23a48f0bd None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:47.786808 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:47.804167 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 188/367] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:47.805072 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff97c9-3bc8-42b7-b724-34dceddb3f63 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:47.859075 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e011-d1cc-410c-9f07-c4f23a48f0bd None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:47.885441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:47.909042 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95335929-3ad0-450d-8d62-8fbd3fe2ee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:47.909723 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95335929-3ad0-450d-8d62-8fbd3fe2ee13 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:47.910015 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95335929-3ad0-450d-8d62-8fbd3fe2ee13 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:47.910299 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95335929-3ad0-450d-8d62-8fbd3fe2ee13 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:47.911296 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95335929-3ad0-450d-8d62-8fbd3fe2ee13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:47.911426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95335929-3ad0-450d-8d62-8fbd3fe2ee13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:47.912854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95335929-3ad0-450d-8d62-8fbd3fe2ee13 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:47.927714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 180/368] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:47.928584 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95335929-3ad0-450d-8d62-8fbd3fe2ee13 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:47.952926 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff97c9-3bc8-42b7-b724-34dceddb3f63 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:47.999758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02fc50-d29a-4c86-90bb-05ceba9cbeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:48.000437 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02fc50-d29a-4c86-90bb-05ceba9cbeae None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:48.000728 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02fc50-d29a-4c86-90bb-05ceba9cbeae None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:48.001006 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02fc50-d29a-4c86-90bb-05ceba9cbeae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:48.002499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02fc50-d29a-4c86-90bb-05ceba9cbeae None admin] RBAC: Adding query filter params (role.id=d1fa8990af404eefaf52fee0dc7d1811, user.id=a0f03025726d46688c2ab5c977a7b971, scope.system=all) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:48.003121 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02fc50-d29a-4c86-90bb-05ceba9cbeae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:48.005016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02fc50-d29a-4c86-90bb-05ceba9cbeae None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:48.023883 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 189/369] 10.222.0.98 () {56 vars in 1308 bytes} [Mon Jul 25 18:56:47 2022] GET /identity/v3/role_assignments?user.id=a0f03025726d46688c2ab5c977a7b971&scope.system=all&role.id=d1fa8990af404eefaf52fee0dc7d1811 => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:48.026648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02fc50-d29a-4c86-90bb-05ceba9cbeae None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:48.076955 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95335929-3ad0-450d-8d62-8fbd3fe2ee13 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:48.111862 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:48.134797 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ff6db-73c1-4166-8079-03f4f1c78653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:48.135505 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ff6db-73c1-4166-8079-03f4f1c78653 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:48.135787 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ff6db-73c1-4166-8079-03f4f1c78653 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:48.136062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ff6db-73c1-4166-8079-03f4f1c78653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:48.138104 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ff6db-73c1-4166-8079-03f4f1c78653 None admin] RBAC: Adding query filter params (group.id=46db6b0d527a438ca10ea2fcd8fad39c, role.id=7bea6298af7e4980950949b024a1e103, scope.project.id=f2fc6165f0384fac8e876908e84085e2) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:48.138433 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ff6db-73c1-4166-8079-03f4f1c78653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:48.141098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ff6db-73c1-4166-8079-03f4f1c78653 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:48.157177 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 181/370] 10.222.0.98 () {56 vars in 1376 bytes} [Mon Jul 25 18:56:47 2022] GET /identity/v3/role_assignments?group.id=46db6b0d527a438ca10ea2fcd8fad39c&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=7bea6298af7e4980950949b024a1e103 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:48.159155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ff6db-73c1-4166-8079-03f4f1c78653 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:48.217131 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02fc50-d29a-4c86-90bb-05ceba9cbeae None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:48.246778 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:48.295577 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768892d0-214f-492c-bc17-341b5a88f630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:48.296398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768892d0-214f-492c-bc17-341b5a88f630 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:48.296685 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768892d0-214f-492c-bc17-341b5a88f630 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:48.296963 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768892d0-214f-492c-bc17-341b5a88f630 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:48.322632 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768892d0-214f-492c-bc17-341b5a88f630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-768892d0-214f-492c-bc17-341b5a88f630 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:48.332585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:48.333528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:48.334317 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:48.336292 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 190/371] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:48.340624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768892d0-214f-492c-bc17-341b5a88f630 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:48.367426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ff6db-73c1-4166-8079-03f4f1c78653 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:48.450558 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4b194-63aa-48e6-885b-639c57bb913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:48.456872 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4b194-63aa-48e6-885b-639c57bb913a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:48.457258 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4b194-63aa-48e6-885b-639c57bb913a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:48.457541 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4b194-63aa-48e6-885b-639c57bb913a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:48.533285 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768892d0-214f-492c-bc17-341b5a88f630 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:48.551821 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:48.553068 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4b194-63aa-48e6-885b-639c57bb913a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:48.554558 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4b194-63aa-48e6-885b-639c57bb913a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:48.590925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12959adb-371b-4e8c-b5ba-78fc19b038e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:48.592335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12959adb-371b-4e8c-b5ba-78fc19b038e3 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:48.592633 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12959adb-371b-4e8c-b5ba-78fc19b038e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:48.592915 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12959adb-371b-4e8c-b5ba-78fc19b038e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:48.593936 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12959adb-371b-4e8c-b5ba-78fc19b038e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:48.594746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12959adb-371b-4e8c-b5ba-78fc19b038e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:48.596692 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12959adb-371b-4e8c-b5ba-78fc19b038e3 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:48.608563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 191/372] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:48.612013 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:48.617920 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12959adb-371b-4e8c-b5ba-78fc19b038e3 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:48.690409 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 182/373] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:48.693874 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4b194-63aa-48e6-885b-639c57bb913a None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:48.752861 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12959adb-371b-4e8c-b5ba-78fc19b038e3 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:48.793294 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e54f8-52b8-4416-9652-3950ec71e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:48.793957 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e54f8-52b8-4416-9652-3950ec71e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:48.794242 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e54f8-52b8-4416-9652-3950ec71e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:48.794523 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e54f8-52b8-4416-9652-3950ec71e3b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:48.847280 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:48.879155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e54f8-52b8-4416-9652-3950ec71e3b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:48.880809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e54f8-52b8-4416-9652-3950ec71e3b8 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:48.928575 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4b194-63aa-48e6-885b-639c57bb913a None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:48.993258 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 192/374] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:48.994742 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35767e7-4623-4c49-be35-75237dbd57ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:48.995694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35767e7-4623-4c49-be35-75237dbd57ae None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:48.995977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35767e7-4623-4c49-be35-75237dbd57ae None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:48.996251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35767e7-4623-4c49-be35-75237dbd57ae None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:48.997491 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35767e7-4623-4c49-be35-75237dbd57ae None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:48.998906 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e54f8-52b8-4416-9652-3950ec71e3b8 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:48.999080 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35767e7-4623-4c49-be35-75237dbd57ae None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:49.001110 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 183/375] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:48 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:49.006628 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35767e7-4623-4c49-be35-75237dbd57ae None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:49.025661 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:49.095611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:49.122389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e54f8-52b8-4416-9652-3950ec71e3b8 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:49.160201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044b54e-0a32-421b-9ead-bcdf6f0f578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:49.160995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044b54e-0a32-421b-9ead-bcdf6f0f578d None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:49.161282 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044b54e-0a32-421b-9ead-bcdf6f0f578d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:49.161558 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044b54e-0a32-421b-9ead-bcdf6f0f578d None admin] PATH_INFO: `/v3/projects/32aa335f68034a49832bdfc49717db33` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:49.162772 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044b54e-0a32-421b-9ead-bcdf6f0f578d None admin] RBAC: Authorizing `identity:get_project(project_id=32aa335f68034a49832bdfc49717db33)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:49.164382 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044b54e-0a32-421b-9ead-bcdf6f0f578d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:49.169949 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 193/376] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:48 2022] GET /identity/v3/projects/32aa335f68034a49832bdfc49717db33 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:49.172864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044b54e-0a32-421b-9ead-bcdf6f0f578d None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:49.182540 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35767e7-4623-4c49-be35-75237dbd57ae None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:49.244268 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c42a0-fa84-4488-9e61-e0b2d0391b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:49.245158 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c42a0-fa84-4488-9e61-e0b2d0391b72 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:49.245442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c42a0-fa84-4488-9e61-e0b2d0391b72 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:49.245718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c42a0-fa84-4488-9e61-e0b2d0391b72 None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:49.247704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c42a0-fa84-4488-9e61-e0b2d0391b72 None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:49.249149 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c42a0-fa84-4488-9e61-e0b2d0391b72 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:49.251099 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 184/377] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:49 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:49.256923 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c42a0-fa84-4488-9e61-e0b2d0391b72 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:49.293102 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044b54e-0a32-421b-9ead-bcdf6f0f578d None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:49.330034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909d6fa-89b9-40de-a243-6270645af4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:49.330911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909d6fa-89b9-40de-a243-6270645af4a6 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:49.331325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909d6fa-89b9-40de-a243-6270645af4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:49.331606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909d6fa-89b9-40de-a243-6270645af4a6 None admin] PATH_INFO: `/v3/groups/d51133d4f0914150b2d8ba830942b430` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:49.337540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909d6fa-89b9-40de-a243-6270645af4a6 None admin] RBAC: Authorizing `identity:get_group(group_id=d51133d4f0914150b2d8ba830942b430)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:49.339102 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909d6fa-89b9-40de-a243-6270645af4a6 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:49.346098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 194/378] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:49 2022] GET /identity/v3/groups/d51133d4f0914150b2d8ba830942b430 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:49.347426 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909d6fa-89b9-40de-a243-6270645af4a6 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:49.351372 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:49.387290 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:49.417153 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c42a0-fa84-4488-9e61-e0b2d0391b72 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:49.456634 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909d6fa-89b9-40de-a243-6270645af4a6 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:49.457241 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caee14e-cbb6-410d-8376-cf365125bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:49.459050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee14e-cbb6-410d-8376-cf365125bb0b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:49.459375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee14e-cbb6-410d-8376-cf365125bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:49.459658 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee14e-cbb6-410d-8376-cf365125bb0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:49.460496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caee14e-cbb6-410d-8376-cf365125bb0b None admin] RBAC: Adding query filter params (group.id=46db6b0d527a438ca10ea2fcd8fad39c, role.id=65e129db80a94ccfba2808ee5768976e, scope.project.id=f2fc6165f0384fac8e876908e84085e2) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:49.460910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caee14e-cbb6-410d-8376-cf365125bb0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:49.462909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caee14e-cbb6-410d-8376-cf365125bb0b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:49.469473 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 185/379] 10.222.0.98 () {56 vars in 1376 bytes} [Mon Jul 25 18:56:49 2022] GET /identity/v3/role_assignments?group.id=46db6b0d527a438ca10ea2fcd8fad39c&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=65e129db80a94ccfba2808ee5768976e => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:49.470931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793792-7413-4e6b-bef7-14687c73b58f None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:49.471355 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793792-7413-4e6b-bef7-14687c73b58f None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:49.471641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793792-7413-4e6b-bef7-14687c73b58f None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:49.473206 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 186/380] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:49.479163 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d14fc-c3bb-4722-acda-4bac1fabac6f None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:49.479459 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d14fc-c3bb-4722-acda-4bac1fabac6f None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:49.479748 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d14fc-c3bb-4722-acda-4bac1fabac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:49.494460 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c1550-f94c-4fb6-ab3c-117a0c8f616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:49.495170 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c1550-f94c-4fb6-ab3c-117a0c8f616e None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:49.495477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c1550-f94c-4fb6-ab3c-117a0c8f616e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:49.495763 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c1550-f94c-4fb6-ab3c-117a0c8f616e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:49.496606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c1550-f94c-4fb6-ab3c-117a0c8f616e None admin] RBAC: Adding query filter params (group.id=d51133d4f0914150b2d8ba830942b430, role.id=472a286d91bd484a83e2de07fc231c06, scope.project.id=32aa335f68034a49832bdfc49717db33) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:49.496925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c1550-f94c-4fb6-ab3c-117a0c8f616e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:49.498391 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c1550-f94c-4fb6-ab3c-117a0c8f616e None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:49.502304 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-bb9d14fc-c3bb-4722-acda-4bac1fabac6f None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:49.503769 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-bb9d14fc-c3bb-4722-acda-4bac1fabac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:49.511353 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 195/381] 10.222.0.98 () {56 vars in 1376 bytes} [Mon Jul 25 18:56:49 2022] GET /identity/v3/role_assignments?group.id=d51133d4f0914150b2d8ba830942b430&scope.project.id=32aa335f68034a49832bdfc49717db33&role.id=472a286d91bd484a83e2de07fc231c06 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:49.603843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 187/382] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:56:49.640396 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c1550-f94c-4fb6-ab3c-117a0c8f616e None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:49.729852 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:49.770581 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c1550-f94c-4fb6-ab3c-117a0c8f616e None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:49.808387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d970b-1de9-48f5-a108-32aa38d47591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:49.809221 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d970b-1de9-48f5-a108-32aa38d47591 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:49.809506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d970b-1de9-48f5-a108-32aa38d47591 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:49.809787 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d970b-1de9-48f5-a108-32aa38d47591 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:49.822799 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d970b-1de9-48f5-a108-32aa38d47591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-4a9d970b-1de9-48f5-a108-32aa38d47591 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:49.831156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:49.832065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:49.832853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 196/383] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:49.839713 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d14fc-c3bb-4722-acda-4bac1fabac6f None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:49.915866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:49.948086 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d14fc-c3bb-4722-acda-4bac1fabac6f None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:49.985408 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffd57a-8e54-412f-92de-97e1dad93738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:49.986084 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffd57a-8e54-412f-92de-97e1dad93738 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:49.986369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffd57a-8e54-412f-92de-97e1dad93738 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:49.986649 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffd57a-8e54-412f-92de-97e1dad93738 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:49.987429 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffd57a-8e54-412f-92de-97e1dad93738 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:49.987739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffd57a-8e54-412f-92de-97e1dad93738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:49.989122 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffd57a-8e54-412f-92de-97e1dad93738 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:49.999554 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 188/384] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:50.006473 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d970b-1de9-48f5-a108-32aa38d47591 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:50.138931 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d970b-1de9-48f5-a108-32aa38d47591 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:50.169401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:50.177663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25da102-a561-43c2-b090-b669194c2498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:50.178516 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25da102-a561-43c2-b090-b669194c2498 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:50.178801 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25da102-a561-43c2-b090-b669194c2498 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:50.179077 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25da102-a561-43c2-b090-b669194c2498 None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:50.180287 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25da102-a561-43c2-b090-b669194c2498 None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:50.182304 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25da102-a561-43c2-b090-b669194c2498 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:50.184367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 197/385] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:50 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:50.194071 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffd57a-8e54-412f-92de-97e1dad93738 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:50.334790 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffd57a-8e54-412f-92de-97e1dad93738 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:50.377757 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd176e1-49d0-40fa-bef1-c140e04ddf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:50.378625 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd176e1-49d0-40fa-bef1-c140e04ddf1d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:50.378908 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd176e1-49d0-40fa-bef1-c140e04ddf1d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:50.379275 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd176e1-49d0-40fa-bef1-c140e04ddf1d None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:50.384450 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd176e1-49d0-40fa-bef1-c140e04ddf1d None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:50.386109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd176e1-49d0-40fa-bef1-c140e04ddf1d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:50.388046 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 189/386] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:50 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:50.393921 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25da102-a561-43c2-b090-b669194c2498 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:50.506414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ebe43-2ab6-45ff-9187-4fd984cee179 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:50.506738 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ebe43-2ab6-45ff-9187-4fd984cee179 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:50.506973 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ebe43-2ab6-45ff-9187-4fd984cee179 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:50.508878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 190/387] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:50.514184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d91977-502e-4064-841a-b7a4d350f7b9 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:50.514473 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d91977-502e-4064-841a-b7a4d350f7b9 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:50.514753 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d91977-502e-4064-841a-b7a4d350f7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:50.530359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:50.537772 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25da102-a561-43c2-b090-b669194c2498 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:50.552310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-85d91977-502e-4064-841a-b7a4d350f7b9 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:50.553520 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-85d91977-502e-4064-841a-b7a4d350f7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:50.592827 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9b23c-69a6-4aec-a79c-6a6293de72c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:50.593959 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9b23c-69a6-4aec-a79c-6a6293de72c8 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:50.594402 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9b23c-69a6-4aec-a79c-6a6293de72c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:50.594820 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9b23c-69a6-4aec-a79c-6a6293de72c8 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400/groups/46db6b0d527a438ca10ea2fcd8fad39c/roles/65e129db80a94ccfba2808ee5768976e` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:50.597431 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9b23c-69a6-4aec-a79c-6a6293de72c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=717b1694b0dd4e97b07cf61aeee56400, group_id=46db6b0d527a438ca10ea2fcd8fad39c, role_id=65e129db80a94ccfba2808ee5768976e)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:50.599237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9b23c-69a6-4aec-a79c-6a6293de72c8 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:50.620451 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 198/388] 10.222.0.98 () {58 vars in 1442 bytes} [Mon Jul 25 18:56:50 2022] PUT /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400/groups/46db6b0d527a438ca10ea2fcd8fad39c/roles/65e129db80a94ccfba2808ee5768976e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:50.668804 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 191/389] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:50.706568 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9b23c-69a6-4aec-a79c-6a6293de72c8 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:50.790354 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:50.836936 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9b23c-69a6-4aec-a79c-6a6293de72c8 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:50.876032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a50d0-fecf-4cb9-a4bb-76dcb77d53be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:50.877075 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a50d0-fecf-4cb9-a4bb-76dcb77d53be None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:50.877509 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a50d0-fecf-4cb9-a4bb-76dcb77d53be None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:50.877932 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a50d0-fecf-4cb9-a4bb-76dcb77d53be None admin] PATH_INFO: `/v3/roles/member` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:50.890976 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a50d0-fecf-4cb9-a4bb-76dcb77d53be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-946a50d0-fecf-4cb9-a4bb-76dcb77d53be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:50.899098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:50.902543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:50.903579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:50.906043 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 199/390] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:50.911670 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d91977-502e-4064-841a-b7a4d350f7b9 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:51.029083 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d91977-502e-4064-841a-b7a4d350f7b9 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:51.061708 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:51.069659 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16199e-df04-462a-a170-d1a06aa4a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:51.070533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16199e-df04-462a-a170-d1a06aa4a3ff None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:51.070818 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16199e-df04-462a-a170-d1a06aa4a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:51.071092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16199e-df04-462a-a170-d1a06aa4a3ff None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:51.072710 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16199e-df04-462a-a170-d1a06aa4a3ff None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:51.073022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16199e-df04-462a-a170-d1a06aa4a3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:51.074403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16199e-df04-462a-a170-d1a06aa4a3ff None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:51.083944 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 192/391] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:51.092287 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a50d0-fecf-4cb9-a4bb-76dcb77d53be None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:51.241867 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a50d0-fecf-4cb9-a4bb-76dcb77d53be None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:51.269069 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:51.291123 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecd846-241f-4c09-8630-54460260d7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:51.292033 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecd846-241f-4c09-8630-54460260d7ab None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:51.292391 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecd846-241f-4c09-8630-54460260d7ab None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:51.292609 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecd846-241f-4c09-8630-54460260d7ab None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:51.293821 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecd846-241f-4c09-8630-54460260d7ab None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:51.295310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecd846-241f-4c09-8630-54460260d7ab None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:51.297258 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 200/392] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:51 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:51.302444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16199e-df04-462a-a170-d1a06aa4a3ff None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:51.459243 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16199e-df04-462a-a170-d1a06aa4a3ff None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:51.502739 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7625f-b346-48bb-a3af-b49ed8ad0989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:51.503543 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7625f-b346-48bb-a3af-b49ed8ad0989 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:51.503826 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7625f-b346-48bb-a3af-b49ed8ad0989 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:51.504101 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7625f-b346-48bb-a3af-b49ed8ad0989 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:51.508132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7625f-b346-48bb-a3af-b49ed8ad0989 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:51.509843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7625f-b346-48bb-a3af-b49ed8ad0989 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:51.511944 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 193/393] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:51 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:51.517799 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecd846-241f-4c09-8630-54460260d7ab None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:51.667205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecd846-241f-4c09-8630-54460260d7ab None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:51.713938 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f617bd7-97e9-4a7d-af38-7c7b95b7cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:51.714897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617bd7-97e9-4a7d-af38-7c7b95b7cac3 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:51.715122 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617bd7-97e9-4a7d-af38-7c7b95b7cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:51.715407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617bd7-97e9-4a7d-af38-7c7b95b7cac3 None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400/groups/46db6b0d527a438ca10ea2fcd8fad39c/roles/7bea6298af7e4980950949b024a1e103` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:51.720447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f617bd7-97e9-4a7d-af38-7c7b95b7cac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=717b1694b0dd4e97b07cf61aeee56400, group_id=46db6b0d527a438ca10ea2fcd8fad39c, role_id=7bea6298af7e4980950949b024a1e103)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:51.721916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f617bd7-97e9-4a7d-af38-7c7b95b7cac3 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:51.739764 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 201/394] 10.222.0.98 () {58 vars in 1442 bytes} [Mon Jul 25 18:56:51 2022] PUT /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400/groups/46db6b0d527a438ca10ea2fcd8fad39c/roles/7bea6298af7e4980950949b024a1e103 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 18:56:51.841163 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4316-e23b-4ce0-9a77-90efd8837c31 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:51.841643 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4316-e23b-4ce0-9a77-90efd8837c31 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:51.841643 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4316-e23b-4ce0-9a77-90efd8837c31 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:51.842964 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 194/395] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:51.851630 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea529-c1c6-4f2b-a56e-043bbffe9fb7 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:51.851923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea529-c1c6-4f2b-a56e-043bbffe9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:51.852216 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea529-c1c6-4f2b-a56e-043bbffe9fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:51.888965 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-107ea529-c1c6-4f2b-a56e-043bbffe9fb7 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:51.889637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-107ea529-c1c6-4f2b-a56e-043bbffe9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:51.943386 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:51.984518 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 202/396] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:52.025446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4316-e23b-4ce0-9a77-90efd8837c31 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:52.120641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:52.177050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4316-e23b-4ce0-9a77-90efd8837c31 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:52.213964 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b8799-9317-4062-81b4-6a9392c1437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:52.215176 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8799-9317-4062-81b4-6a9392c1437b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:52.215668 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8799-9317-4062-81b4-6a9392c1437b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:52.216147 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8799-9317-4062-81b4-6a9392c1437b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:52.228198 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b8799-9317-4062-81b4-6a9392c1437b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-f52b8799-9317-4062-81b4-6a9392c1437b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:52.236338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:52.237253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:52.238050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:52.240763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 195/397] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:52.247537 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ea529-c1c6-4f2b-a56e-043bbffe9fb7 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:52.397728 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ea529-c1c6-4f2b-a56e-043bbffe9fb7 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:52.445562 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d7d31-2c00-4b34-a74b-3823abb5954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:52.446822 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d7d31-2c00-4b34-a74b-3823abb5954b None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:52.447282 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d7d31-2c00-4b34-a74b-3823abb5954b None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:52.447652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d7d31-2c00-4b34-a74b-3823abb5954b None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:52.448406 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d7d31-2c00-4b34-a74b-3823abb5954b None admin] RBAC: Adding query filter params (name=member) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:52.448717 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d7d31-2c00-4b34-a74b-3823abb5954b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:52.450099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d7d31-2c00-4b34-a74b-3823abb5954b None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:52.461147 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 203/398] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:52.467039 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b8799-9317-4062-81b4-6a9392c1437b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:52.614746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b8799-9317-4062-81b4-6a9392c1437b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:52.641964 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:52.657148 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c543046-800a-408f-b7d6-d27939fd9355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:52.657942 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c543046-800a-408f-b7d6-d27939fd9355 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:52.658228 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c543046-800a-408f-b7d6-d27939fd9355 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:52.658505 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c543046-800a-408f-b7d6-d27939fd9355 None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:52.659803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c543046-800a-408f-b7d6-d27939fd9355 None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:52.661427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c543046-800a-408f-b7d6-d27939fd9355 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:52.663389 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 196/399] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:52 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:52.668921 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d7d31-2c00-4b34-a74b-3823abb5954b None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:52.730244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:52.830911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d7d31-2c00-4b34-a74b-3823abb5954b None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:52.844236 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515d26e-1077-40fd-b72a-3a7f68452c0d None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:52.844732 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515d26e-1077-40fd-b72a-3a7f68452c0d None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:52.844931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515d26e-1077-40fd-b72a-3a7f68452c0d None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:52.846593 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 197/400] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:52.851922 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd363-7529-4bd1-a536-458918b7e666 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:52.852216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd363-7529-4bd1-a536-458918b7e666 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:52.852571 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd363-7529-4bd1-a536-458918b7e666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:52.890554 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143ebb0-677d-4a4e-83a8-d26829224a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:52.891494 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143ebb0-677d-4a4e-83a8-d26829224a06 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:52.891789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143ebb0-677d-4a4e-83a8-d26829224a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:52.892073 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143ebb0-677d-4a4e-83a8-d26829224a06 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:52.893378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143ebb0-677d-4a4e-83a8-d26829224a06 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:52.897443 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143ebb0-677d-4a4e-83a8-d26829224a06 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:52.899962 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 204/401] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:52 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:52.907846 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143ebb0-677d-4a4e-83a8-d26829224a06 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:53.016212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-ca3fd363-7529-4bd1-a536-458918b7e666 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:53.017424 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-ca3fd363-7529-4bd1-a536-458918b7e666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:53.056658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143ebb0-677d-4a4e-83a8-d26829224a06 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:53.059647 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:53.095773 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154ad5c-9540-4031-8ce1-ad00803e8908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:53.096662 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ad5c-9540-4031-8ce1-ad00803e8908 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:53.096948 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ad5c-9540-4031-8ce1-ad00803e8908 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:53.097292 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ad5c-9540-4031-8ce1-ad00803e8908 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2/groups/46db6b0d527a438ca10ea2fcd8fad39c/roles/7bea6298af7e4980950949b024a1e103` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:53.099376 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154ad5c-9540-4031-8ce1-ad00803e8908 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2fc6165f0384fac8e876908e84085e2, group_id=46db6b0d527a438ca10ea2fcd8fad39c, role_id=7bea6298af7e4980950949b024a1e103)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:53.100915 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154ad5c-9540-4031-8ce1-ad00803e8908 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:53.117731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 198/403] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:56:53.117919 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 205/403] 10.222.0.98 () {58 vars in 1442 bytes} [Mon Jul 25 18:56:52 2022] PUT /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2/groups/46db6b0d527a438ca10ea2fcd8fad39c/roles/7bea6298af7e4980950949b024a1e103 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:53.120459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956efa4-a85a-4947-8303-befe8ab10db9 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:53.121046 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956efa4-a85a-4947-8303-befe8ab10db9 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:53.121524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956efa4-a85a-4947-8303-befe8ab10db9 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:53.127559 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 206/404] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:53.129840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bf660-93a2-4398-bf3b-293150d03628 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:53.130385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bf660-93a2-4398-bf3b-293150d03628 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:53.130864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bf660-93a2-4398-bf3b-293150d03628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:53.146031 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956efa4-a85a-4947-8303-befe8ab10db9 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:53.153657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-e99bf660-93a2-4398-bf3b-293150d03628 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:53.154974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-e99bf660-93a2-4398-bf3b-293150d03628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:53.288899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956efa4-a85a-4947-8303-befe8ab10db9 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:53.320517 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 199/405] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:53.333618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e2586-5de3-403b-863f-ea9ccb0a7579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:53.334826 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e2586-5de3-403b-863f-ea9ccb0a7579 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:53.335410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e2586-5de3-403b-863f-ea9ccb0a7579 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:53.336009 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e2586-5de3-403b-863f-ea9ccb0a7579 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:53.348947 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e2586-5de3-403b-863f-ea9ccb0a7579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-005e2586-5de3-403b-863f-ea9ccb0a7579 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:53.358677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:53.359853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:53.360637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:53.363420 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 207/406] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:53.366729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bf660-93a2-4398-bf3b-293150d03628 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:53.371201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e2586-5de3-403b-863f-ea9ccb0a7579 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:53.403169 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:53.473653 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:53.515891 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e2586-5de3-403b-863f-ea9ccb0a7579 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:53.532096 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bf660-93a2-4398-bf3b-293150d03628 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:53.564543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc81ad-0f42-4b93-a53b-aa0ac3dce101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:53.565734 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc81ad-0f42-4b93-a53b-aa0ac3dce101 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:53.566584 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc81ad-0f42-4b93-a53b-aa0ac3dce101 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:53.567068 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc81ad-0f42-4b93-a53b-aa0ac3dce101 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:53.568330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc81ad-0f42-4b93-a53b-aa0ac3dce101 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:53.569038 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc81ad-0f42-4b93-a53b-aa0ac3dce101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:53.571023 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc81ad-0f42-4b93-a53b-aa0ac3dce101 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:53.572577 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cedf71-1686-4ebb-a1f8-621f128b4771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:53.573375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cedf71-1686-4ebb-a1f8-621f128b4771 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:53.573659 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cedf71-1686-4ebb-a1f8-621f128b4771 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:53.573923 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cedf71-1686-4ebb-a1f8-621f128b4771 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:53.585149 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 208/407] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:53.591750 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cedf71-1686-4ebb-a1f8-621f128b4771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:53.592399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc81ad-0f42-4b93-a53b-aa0ac3dce101 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-40cedf71-1686-4ebb-a1f8-621f128b4771 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:53.599679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:53.600654 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:53.601446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 200/408] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:56:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:53.608173 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cedf71-1686-4ebb-a1f8-621f128b4771 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:53.726122 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:53.754982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc81ad-0f42-4b93-a53b-aa0ac3dce101 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:53.789122 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cedf71-1686-4ebb-a1f8-621f128b4771 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:53.804176 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:53.809637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7346364-fad9-4823-b639-8d7b7453a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:53.810515 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346364-fad9-4823-b639-8d7b7453a808 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:53.810802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346364-fad9-4823-b639-8d7b7453a808 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:53.811164 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346364-fad9-4823-b639-8d7b7453a808 None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:53.812934 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7346364-fad9-4823-b639-8d7b7453a808 None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:53.814415 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7346364-fad9-4823-b639-8d7b7453a808 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:53.816154 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 209/409] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:53 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:53.824595 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7346364-fad9-4823-b639-8d7b7453a808 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:53.850301 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326eb61-525b-4495-a093-5a2d79d901e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:53.852270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326eb61-525b-4495-a093-5a2d79d901e5 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:53.853029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326eb61-525b-4495-a093-5a2d79d901e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:53.853643 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326eb61-525b-4495-a093-5a2d79d901e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:53.854847 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326eb61-525b-4495-a093-5a2d79d901e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:53.855812 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326eb61-525b-4495-a093-5a2d79d901e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:53.857962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326eb61-525b-4495-a093-5a2d79d901e5 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:53.870729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 201/410] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:53.872378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67067c73-1e3e-4d17-9e62-c44e53bd377d None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:53.872871 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67067c73-1e3e-4d17-9e62-c44e53bd377d None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:53.873373 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67067c73-1e3e-4d17-9e62-c44e53bd377d None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:53.874913 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 202/411] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:53.879997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67067c73-1e3e-4d17-9e62-c44e53bd377d None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:53.965184 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7346364-fad9-4823-b639-8d7b7453a808 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:53.997083 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67067c73-1e3e-4d17-9e62-c44e53bd377d None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:54.011949 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c8f4c-dd82-4f7f-9906-8b00464b679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:54.014011 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8f4c-dd82-4f7f-9906-8b00464b679a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.014506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8f4c-dd82-4f7f-9906-8b00464b679a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.015262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c8f4c-dd82-4f7f-9906-8b00464b679a None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:54.017184 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c8f4c-dd82-4f7f-9906-8b00464b679a None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:54.018885 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c8f4c-dd82-4f7f-9906-8b00464b679a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:54.021642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 210/412] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:53 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:54.028237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd2aa-f099-491a-8743-8b54c2a712a3 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.028753 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd2aa-f099-491a-8743-8b54c2a712a3 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.029256 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd2aa-f099-491a-8743-8b54c2a712a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:54.040292 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb51e1-e49e-44f5-9bea-358766a20dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:54.041245 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb51e1-e49e-44f5-9bea-358766a20dfa None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.041531 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb51e1-e49e-44f5-9bea-358766a20dfa None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.041814 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb51e1-e49e-44f5-9bea-358766a20dfa None admin] PATH_INFO: `/v3/groups/d51133d4f0914150b2d8ba830942b430` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:54.043008 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb51e1-e49e-44f5-9bea-358766a20dfa None admin] RBAC: Authorizing `identity:get_group(group_id=d51133d4f0914150b2d8ba830942b430)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:54.045139 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb51e1-e49e-44f5-9bea-358766a20dfa None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:54.047099 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 203/413] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:53 2022] GET /identity/v3/groups/d51133d4f0914150b2d8ba830942b430 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:54.048466 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb51e1-e49e-44f5-9bea-358766a20dfa None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:54.055429 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-9fdbd2aa-f099-491a-8743-8b54c2a712a3 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:54.057252 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-9fdbd2aa-f099-491a-8743-8b54c2a712a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:54.077532 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:54.102106 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:54.152729 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 211/414] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:54.155265 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd2aa-f099-491a-8743-8b54c2a712a3 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:54.201339 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb51e1-e49e-44f5-9bea-358766a20dfa None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:54.238821 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e064798-17f0-4d8a-827d-01586fe676a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:54.240152 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e064798-17f0-4d8a-827d-01586fe676a4 None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.240646 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e064798-17f0-4d8a-827d-01586fe676a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.241129 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e064798-17f0-4d8a-827d-01586fe676a4 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2/groups/46db6b0d527a438ca10ea2fcd8fad39c/roles/65e129db80a94ccfba2808ee5768976e` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:54.244033 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e064798-17f0-4d8a-827d-01586fe676a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2fc6165f0384fac8e876908e84085e2, group_id=46db6b0d527a438ca10ea2fcd8fad39c, role_id=65e129db80a94ccfba2808ee5768976e)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:54.245711 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e064798-17f0-4d8a-827d-01586fe676a4 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:54.261200 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 204/415] 10.222.0.98 () {58 vars in 1442 bytes} [Mon Jul 25 18:56:54 2022] PUT /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2/groups/46db6b0d527a438ca10ea2fcd8fad39c/roles/65e129db80a94ccfba2808ee5768976e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:54.262641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e064798-17f0-4d8a-827d-01586fe676a4 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:54.318215 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd2aa-f099-491a-8743-8b54c2a712a3 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:54.387774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e064798-17f0-4d8a-827d-01586fe676a4 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:54.390646 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:54.395079 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8facc-6729-4bab-b6bb-67ba9e5a6cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:54.396002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8facc-6729-4bab-b6bb-67ba9e5a6cb9 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.396290 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8facc-6729-4bab-b6bb-67ba9e5a6cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.396569 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8facc-6729-4bab-b6bb-67ba9e5a6cb9 None admin] PATH_INFO: `/v3/projects/32aa335f68034a49832bdfc49717db33` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:54.400275 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8facc-6729-4bab-b6bb-67ba9e5a6cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=32aa335f68034a49832bdfc49717db33)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:54.403835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8facc-6729-4bab-b6bb-67ba9e5a6cb9 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:54.409081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 212/416] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:54 2022] GET /identity/v3/projects/32aa335f68034a49832bdfc49717db33 => generated 344 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:54.414100 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8facc-6729-4bab-b6bb-67ba9e5a6cb9 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:54.451937 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:54.499723 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b363d-6436-4d51-ac75-04ce23eb6803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:54.500549 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b363d-6436-4d51-ac75-04ce23eb6803 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.500836 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b363d-6436-4d51-ac75-04ce23eb6803 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.501115 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b363d-6436-4d51-ac75-04ce23eb6803 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:54.521781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b363d-6436-4d51-ac75-04ce23eb6803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-879b363d-6436-4d51-ac75-04ce23eb6803 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:54.531606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:54.532581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:54.533395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:54.536711 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 205/417] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:56:54.542293 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b363d-6436-4d51-ac75-04ce23eb6803 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:54.544181 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8facc-6729-4bab-b6bb-67ba9e5a6cb9 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:54.587949 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f17bd3-1a67-4b74-aff8-55731609c866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:54.588853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f17bd3-1a67-4b74-aff8-55731609c866 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.589140 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f17bd3-1a67-4b74-aff8-55731609c866 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.589418 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f17bd3-1a67-4b74-aff8-55731609c866 None admin] PATH_INFO: `/v3/projects/32aa335f68034a49832bdfc49717db33/groups/d51133d4f0914150b2d8ba830942b430/roles/472a286d91bd484a83e2de07fc231c06` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:54.593859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f17bd3-1a67-4b74-aff8-55731609c866 None admin] RBAC: Authorizing `identity:create_grant(project_id=32aa335f68034a49832bdfc49717db33, group_id=d51133d4f0914150b2d8ba830942b430, role_id=472a286d91bd484a83e2de07fc231c06)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:54.595391 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f17bd3-1a67-4b74-aff8-55731609c866 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:54.635160 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 213/418] 10.222.0.98 () {58 vars in 1442 bytes} [Mon Jul 25 18:56:54 2022] PUT /identity/v3/projects/32aa335f68034a49832bdfc49717db33/groups/d51133d4f0914150b2d8ba830942b430/roles/472a286d91bd484a83e2de07fc231c06 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:56:54.696422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b363d-6436-4d51-ac75-04ce23eb6803 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:54.716762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9576-d135-420f-a531-cde134b2b7ed None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.716961 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9576-d135-420f-a531-cde134b2b7ed None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.717239 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9576-d135-420f-a531-cde134b2b7ed None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:54.719021 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 214/419] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:54.724182 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411c59a-2be9-47dd-94a9-0fa1bb226ab7 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.724473 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411c59a-2be9-47dd-94a9-0fa1bb226ab7 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.724756 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411c59a-2be9-47dd-94a9-0fa1bb226ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:54.742345 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb91e2c-3f33-40ad-a972-ff47053544a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:54.744304 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb91e2c-3f33-40ad-a972-ff47053544a4 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.745014 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb91e2c-3f33-40ad-a972-ff47053544a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.745584 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb91e2c-3f33-40ad-a972-ff47053544a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:54.746591 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb91e2c-3f33-40ad-a972-ff47053544a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:54.747182 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb91e2c-3f33-40ad-a972-ff47053544a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:54.748973 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb91e2c-3f33-40ad-a972-ff47053544a4 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:54.760509 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 206/420] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:54.767045 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb91e2c-3f33-40ad-a972-ff47053544a4 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:54.773897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-6411c59a-2be9-47dd-94a9-0fa1bb226ab7 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:54.775420 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-6411c59a-2be9-47dd-94a9-0fa1bb226ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:54.812950 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:54.913768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 215/421] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:54.939089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb91e2c-3f33-40ad-a972-ff47053544a4 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:54.947653 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411c59a-2be9-47dd-94a9-0fa1bb226ab7 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:54.973836 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:54.976390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba9df5-c9e3-47a0-8cad-833bcd9b73d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:54.978058 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9df5-c9e3-47a0-8cad-833bcd9b73d1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:54.978058 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9df5-c9e3-47a0-8cad-833bcd9b73d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:54.978360 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9df5-c9e3-47a0-8cad-833bcd9b73d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:55.058680 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba9df5-c9e3-47a0-8cad-833bcd9b73d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:55.064146 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba9df5-c9e3-47a0-8cad-833bcd9b73d1 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:55.100063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:55.101624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411c59a-2be9-47dd-94a9-0fa1bb226ab7 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:55.145796 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3beefe-042f-491a-8a14-6876239d3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:55.146656 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3beefe-042f-491a-8a14-6876239d3154 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:55.146941 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3beefe-042f-491a-8a14-6876239d3154 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:55.147256 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3beefe-042f-491a-8a14-6876239d3154 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:55.158288 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3beefe-042f-491a-8a14-6876239d3154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-ce3beefe-042f-491a-8a14-6876239d3154 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:55.167366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:55.168303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:55.169298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 216/422] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:56:55.175976 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3beefe-042f-491a-8a14-6876239d3154 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:55.231744 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 207/423] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:55.240122 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba9df5-c9e3-47a0-8cad-833bcd9b73d1 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:55.346443 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:55.396903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3beefe-042f-491a-8a14-6876239d3154 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:55.432580 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1928-7326-44ed-9a84-59ed334165f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:55.433225 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1928-7326-44ed-9a84-59ed334165f1 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:55.433511 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1928-7326-44ed-9a84-59ed334165f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:55.433790 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1928-7326-44ed-9a84-59ed334165f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:55.434539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1928-7326-44ed-9a84-59ed334165f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:55.434850 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1928-7326-44ed-9a84-59ed334165f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:55.437639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba9df5-c9e3-47a0-8cad-833bcd9b73d1 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:55.444426 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1928-7326-44ed-9a84-59ed334165f1 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:55.463832 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 217/424] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:55.465928 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1928-7326-44ed-9a84-59ed334165f1 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:55.471225 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:55.496164 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa46c2-07ab-4a25-b13c-81f3011bcb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:55.497681 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa46c2-07ab-4a25-b13c-81f3011bcb9e None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:55.498174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa46c2-07ab-4a25-b13c-81f3011bcb9e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:55.498653 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa46c2-07ab-4a25-b13c-81f3011bcb9e None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:55.501066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa46c2-07ab-4a25-b13c-81f3011bcb9e None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:55.502957 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa46c2-07ab-4a25-b13c-81f3011bcb9e None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:55.507922 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 208/425] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:55 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:55.512870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa46c2-07ab-4a25-b13c-81f3011bcb9e None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:55.643235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1928-7326-44ed-9a84-59ed334165f1 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:55.718209 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:55.722779 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa46c2-07ab-4a25-b13c-81f3011bcb9e None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:55.725669 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0220e6-1a5a-4b83-af15-8ac0897267d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:55.726567 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0220e6-1a5a-4b83-af15-8ac0897267d9 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:55.727060 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0220e6-1a5a-4b83-af15-8ac0897267d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:55.728237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0220e6-1a5a-4b83-af15-8ac0897267d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:55.802152 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a6c84-8de3-4c49-91e9-87e225b494e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:55.804196 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a6c84-8de3-4c49-91e9-87e225b494e6 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:55.809593 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a6c84-8de3-4c49-91e9-87e225b494e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:55.810097 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a6c84-8de3-4c49-91e9-87e225b494e6 None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:55.811780 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a6c84-8de3-4c49-91e9-87e225b494e6 None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:55.813432 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a6c84-8de3-4c49-91e9-87e225b494e6 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:55.815527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 209/426] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:55 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:55.826889 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a6c84-8de3-4c49-91e9-87e225b494e6 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:55.849122 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0220e6-1a5a-4b83-af15-8ac0897267d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:55.850598 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0220e6-1a5a-4b83-af15-8ac0897267d9 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:55.907063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:55.954714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a6c84-8de3-4c49-91e9-87e225b494e6 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:55.961303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 218/427] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 18:56:55.964023 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0220e6-1a5a-4b83-af15-8ac0897267d9 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:56.001925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:56.016995 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8276ac-afd4-4580-bcfb-a4b0dda5362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:56.017668 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8276ac-afd4-4580-bcfb-a4b0dda5362e None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.017953 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8276ac-afd4-4580-bcfb-a4b0dda5362e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.018232 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8276ac-afd4-4580-bcfb-a4b0dda5362e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.019372 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8276ac-afd4-4580-bcfb-a4b0dda5362e None admin] RBAC: Adding query filter params (group.id=46db6b0d527a438ca10ea2fcd8fad39c, role.id=65e129db80a94ccfba2808ee5768976e, scope.project.id=717b1694b0dd4e97b07cf61aeee56400) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:56.020118 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8276ac-afd4-4580-bcfb-a4b0dda5362e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:56.021803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8276ac-afd4-4580-bcfb-a4b0dda5362e None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:56.031057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 210/428] 10.222.0.98 () {56 vars in 1376 bytes} [Mon Jul 25 18:56:55 2022] GET /identity/v3/role_assignments?group.id=46db6b0d527a438ca10ea2fcd8fad39c&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=65e129db80a94ccfba2808ee5768976e => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:56.035559 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396ddd3-b688-4e7e-b187-a04db7f4ec48 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.035865 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396ddd3-b688-4e7e-b187-a04db7f4ec48 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.036150 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396ddd3-b688-4e7e-b187-a04db7f4ec48 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.037560 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 211/429] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:56.047585 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786334a0-c7ad-4298-a936-754f4a6548f8 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.047897 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786334a0-c7ad-4298-a936-754f4a6548f8 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.048150 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786334a0-c7ad-4298-a936-754f4a6548f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.080943 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-786334a0-c7ad-4298-a936-754f4a6548f8 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:56.082097 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-786334a0-c7ad-4298-a936-754f4a6548f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:56.140463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0220e6-1a5a-4b83-af15-8ac0897267d9 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:56.204140 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 212/430] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 25 18:56:56.220274 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1eaf-3685-4656-a64b-b03ef05d446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:56.221456 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1eaf-3685-4656-a64b-b03ef05d446d None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.221887 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1eaf-3685-4656-a64b-b03ef05d446d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.222306 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1eaf-3685-4656-a64b-b03ef05d446d None admin] PATH_INFO: `/v3/projects/717b1694b0dd4e97b07cf61aeee56400` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.225423 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1eaf-3685-4656-a64b-b03ef05d446d None admin] RBAC: Authorizing `identity:get_project(project_id=717b1694b0dd4e97b07cf61aeee56400)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:56.227397 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1eaf-3685-4656-a64b-b03ef05d446d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:56.231006 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 219/431] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:55 2022] GET /identity/v3/projects/717b1694b0dd4e97b07cf61aeee56400 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:56.235164 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786334a0-c7ad-4298-a936-754f4a6548f8 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:56.236634 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1eaf-3685-4656-a64b-b03ef05d446d None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:56.305245 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:56.362063 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:56.367543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1eaf-3685-4656-a64b-b03ef05d446d None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:56.369476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786334a0-c7ad-4298-a936-754f4a6548f8 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:56.409866 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d99c-229d-40af-ad81-38f4616e9193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:56.411336 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d99c-229d-40af-ad81-38f4616e9193 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.411764 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d99c-229d-40af-ad81-38f4616e9193 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.412182 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d99c-229d-40af-ad81-38f4616e9193 None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.413638 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96d99c-229d-40af-ad81-38f4616e9193 None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:56.416600 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96d99c-229d-40af-ad81-38f4616e9193 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:56.418783 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 220/432] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:56 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:56.420717 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac272e0-bdf4-4532-8fd2-26822cfc6ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:56.421572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac272e0-bdf4-4532-8fd2-26822cfc6ccc None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.421853 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac272e0-bdf4-4532-8fd2-26822cfc6ccc None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.422121 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac272e0-bdf4-4532-8fd2-26822cfc6ccc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.425433 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d99c-229d-40af-ad81-38f4616e9193 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:56.437470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac272e0-bdf4-4532-8fd2-26822cfc6ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-8ac272e0-bdf4-4532-8fd2-26822cfc6ccc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:56.448794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:56.449683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 18:56:56.450486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:56.451099 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 213/433] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:56:56.458311 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac272e0-bdf4-4532-8fd2-26822cfc6ccc None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:56.557562 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d99c-229d-40af-ad81-38f4616e9193 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:56.585415 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac272e0-bdf4-4532-8fd2-26822cfc6ccc None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:56.599790 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:56.604374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e714e-210d-458d-a205-c9b98b3e17e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:56.605385 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e714e-210d-458d-a205-c9b98b3e17e8 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.605738 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e714e-210d-458d-a205-c9b98b3e17e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.606084 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e714e-210d-458d-a205-c9b98b3e17e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.607162 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e714e-210d-458d-a205-c9b98b3e17e8 None admin] RBAC: Adding query filter params (group.id=46db6b0d527a438ca10ea2fcd8fad39c, role.id=7bea6298af7e4980950949b024a1e103, scope.project.id=717b1694b0dd4e97b07cf61aeee56400) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:56.607570 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e714e-210d-458d-a205-c9b98b3e17e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:56.609392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e714e-210d-458d-a205-c9b98b3e17e8 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:56.623656 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 221/434] 10.222.0.98 () {56 vars in 1376 bytes} [Mon Jul 25 18:56:56 2022] GET /identity/v3/role_assignments?group.id=46db6b0d527a438ca10ea2fcd8fad39c&scope.project.id=717b1694b0dd4e97b07cf61aeee56400&role.id=7bea6298af7e4980950949b024a1e103 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:56.641808 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87fe1f-568c-450c-9aeb-4c6412d72801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:56.642952 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87fe1f-568c-450c-9aeb-4c6412d72801 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.643520 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87fe1f-568c-450c-9aeb-4c6412d72801 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.643995 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87fe1f-568c-450c-9aeb-4c6412d72801 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.644983 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87fe1f-568c-450c-9aeb-4c6412d72801 None admin] RBAC: Adding query filter params (name=member) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:56.645504 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87fe1f-568c-450c-9aeb-4c6412d72801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:56.647214 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87fe1f-568c-450c-9aeb-4c6412d72801 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:56.659045 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 214/435] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:56:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:56.664292 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e714e-210d-458d-a205-c9b98b3e17e8 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:56.704111 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:56.797120 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e714e-210d-458d-a205-c9b98b3e17e8 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:56.835723 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df256903-bbbf-474a-b927-2f04c1221c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:56.836383 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df256903-bbbf-474a-b927-2f04c1221c56 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.836738 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df256903-bbbf-474a-b927-2f04c1221c56 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.837045 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df256903-bbbf-474a-b927-2f04c1221c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.912940 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df256903-bbbf-474a-b927-2f04c1221c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:56.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df256903-bbbf-474a-b927-2f04c1221c56 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:56.931720 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadec9c9-fc6a-417c-bced-2386716a1ac9 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.932053 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadec9c9-fc6a-417c-bced-2386716a1ac9 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.932287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadec9c9-fc6a-417c-bced-2386716a1ac9 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.933810 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 215/436] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:56:56.939497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c622b12-b32a-440e-aa25-430e1bde54ee None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:56.939791 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c622b12-b32a-440e-aa25-430e1bde54ee None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:56.940077 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c622b12-b32a-440e-aa25-430e1bde54ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:56.952726 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:56.967913 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-6c622b12-b32a-440e-aa25-430e1bde54ee None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:56.969530 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-6c622b12-b32a-440e-aa25-430e1bde54ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:57.052728 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 222/437] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:57.059072 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df256903-bbbf-474a-b927-2f04c1221c56 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:57.063399 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 216/438] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:57.087423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c622b12-b32a-440e-aa25-430e1bde54ee None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:57.179468 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df256903-bbbf-474a-b927-2f04c1221c56 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:57.221202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:57.228482 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a6052-e6c7-4d64-a023-5cac21754946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:57.229831 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a6052-e6c7-4d64-a023-5cac21754946 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:57.230344 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a6052-e6c7-4d64-a023-5cac21754946 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:57.230849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a6052-e6c7-4d64-a023-5cac21754946 None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:57.232340 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a6052-e6c7-4d64-a023-5cac21754946 None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:57.232719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c622b12-b32a-440e-aa25-430e1bde54ee None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:57.234379 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a6052-e6c7-4d64-a023-5cac21754946 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:57.235095 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:57.237269 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 223/439] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:57 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:57.244285 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a6052-e6c7-4d64-a023-5cac21754946 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:57.276793 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be8514-08fc-4f16-8508-7e1bb54df2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:57.278013 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be8514-08fc-4f16-8508-7e1bb54df2c0 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:57.278638 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be8514-08fc-4f16-8508-7e1bb54df2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:57.279160 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be8514-08fc-4f16-8508-7e1bb54df2c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:57.294196 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be8514-08fc-4f16-8508-7e1bb54df2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-03be8514-08fc-4f16-8508-7e1bb54df2c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:57.303298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:57.304247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 18:56:57.305038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:56:57.308215 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 217/440] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:56:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:56:57.314423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be8514-08fc-4f16-8508-7e1bb54df2c0 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:57.370506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a6052-e6c7-4d64-a023-5cac21754946 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:57.417919 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf871-6ea7-4439-86ea-a5ebe0f3cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:57.418911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf871-6ea7-4439-86ea-a5ebe0f3cf59 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:57.419222 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf871-6ea7-4439-86ea-a5ebe0f3cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:57.419543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf871-6ea7-4439-86ea-a5ebe0f3cf59 None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:57.420855 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bf871-6ea7-4439-86ea-a5ebe0f3cf59 None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:57.422438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bf871-6ea7-4439-86ea-a5ebe0f3cf59 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:57.424313 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 224/441] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:57 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:57.430067 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf871-6ea7-4439-86ea-a5ebe0f3cf59 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:57.445016 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be8514-08fc-4f16-8508-7e1bb54df2c0 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:57.479849 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37929b1-84d6-4d68-8c4e-eaa76f4e783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:57.480510 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37929b1-84d6-4d68-8c4e-eaa76f4e783f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:57.480794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37929b1-84d6-4d68-8c4e-eaa76f4e783f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:57.481073 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37929b1-84d6-4d68-8c4e-eaa76f4e783f None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:57.481807 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37929b1-84d6-4d68-8c4e-eaa76f4e783f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:57.482112 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37929b1-84d6-4d68-8c4e-eaa76f4e783f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:57.483498 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37929b1-84d6-4d68-8c4e-eaa76f4e783f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:57.491665 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 218/442] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:56:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:57.491665 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c51a-a400-49bf-b909-3f754f2b9ec2 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:57.491665 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c51a-a400-49bf-b909-3f754f2b9ec2 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:57.491665 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c51a-a400-49bf-b909-3f754f2b9ec2 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:57.491665 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 219/443] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:56:57.498928 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:57.500394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c51a-a400-49bf-b909-3f754f2b9ec2 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:57.529483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:57.536066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf871-6ea7-4439-86ea-a5ebe0f3cf59 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:57.569940 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0282e-2baa-4610-8b8c-4925a4928fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:57.570604 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0282e-2baa-4610-8b8c-4925a4928fcc None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:57.570887 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0282e-2baa-4610-8b8c-4925a4928fcc None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:57.571765 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0282e-2baa-4610-8b8c-4925a4928fcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:57.572648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0282e-2baa-4610-8b8c-4925a4928fcc None admin] RBAC: Adding query filter params (group.id=46db6b0d527a438ca10ea2fcd8fad39c, role.id=7bea6298af7e4980950949b024a1e103, scope.project.id=f2fc6165f0384fac8e876908e84085e2) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:57.572971 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0282e-2baa-4610-8b8c-4925a4928fcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:57.574411 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0282e-2baa-4610-8b8c-4925a4928fcc None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:57.580202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 225/444] 10.222.0.98 () {56 vars in 1376 bytes} [Mon Jul 25 18:56:57 2022] GET /identity/v3/role_assignments?group.id=46db6b0d527a438ca10ea2fcd8fad39c&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=7bea6298af7e4980950949b024a1e103 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:57.581466 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf7c5-5f37-40c6-9eaa-6e5ce5a0e14d None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:57.581765 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf7c5-5f37-40c6-9eaa-6e5ce5a0e14d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:57.582044 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf7c5-5f37-40c6-9eaa-6e5ce5a0e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:57.610490 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-dfdaf7c5-5f37-40c6-9eaa-6e5ce5a0e14d None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:56:57.611791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-dfdaf7c5-5f37-40c6-9eaa-6e5ce5a0e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:56:57.624379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c51a-a400-49bf-b909-3f754f2b9ec2 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:57.666579 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6fe09-6e36-4eb8-9d37-8c5ff9e2b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:57.667591 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6fe09-6e36-4eb8-9d37-8c5ff9e2b7f6 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:57.667880 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6fe09-6e36-4eb8-9d37-8c5ff9e2b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:57.668160 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6fe09-6e36-4eb8-9d37-8c5ff9e2b7f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:57.695307 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 226/445] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:56:57.721429 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaf7c5-5f37-40c6-9eaa-6e5ce5a0e14d None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:57.755649 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6fe09-6e36-4eb8-9d37-8c5ff9e2b7f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:57.757957 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6fe09-6e36-4eb8-9d37-8c5ff9e2b7f6 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:57.793146 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:57.794265 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:57.843601 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaf7c5-5f37-40c6-9eaa-6e5ce5a0e14d None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:57.886691 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ae0b-973a-4df4-ba27-3eeece49f05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:57.887483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 220/446] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:57.887619 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ae0b-973a-4df4-ba27-3eeece49f05f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:57.887908 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ae0b-973a-4df4-ba27-3eeece49f05f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:57.888193 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ae0b-973a-4df4-ba27-3eeece49f05f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:57.893429 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6fe09-6e36-4eb8-9d37-8c5ff9e2b7f6 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:57.900503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391ae0b-973a-4df4-ba27-3eeece49f05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-3391ae0b-973a-4df4-ba27-3eeece49f05f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:56:57.908335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:56:57.909262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:56:57.910062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 227/447] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:56:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:56:57.916056 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ae0b-973a-4df4-ba27-3eeece49f05f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:58.018244 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6fe09-6e36-4eb8-9d37-8c5ff9e2b7f6 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:58.030410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ae0b-973a-4df4-ba27-3eeece49f05f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:58.044562 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:58.053057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b74dd-ccd5-464f-9bcc-ec1c1a249aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:58.053239 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:58.053928 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b74dd-ccd5-464f-9bcc-ec1c1a249aca None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:58.054236 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b74dd-ccd5-464f-9bcc-ec1c1a249aca None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:58.054499 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b74dd-ccd5-464f-9bcc-ec1c1a249aca None admin] PATH_INFO: `/v3/projects/f2fc6165f0384fac8e876908e84085e2` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:58.056576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b74dd-ccd5-464f-9bcc-ec1c1a249aca None admin] RBAC: Authorizing `identity:get_project(project_id=f2fc6165f0384fac8e876908e84085e2)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:58.058027 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b74dd-ccd5-464f-9bcc-ec1c1a249aca None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:58.059749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 221/448] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:57 2022] GET /identity/v3/projects/f2fc6165f0384fac8e876908e84085e2 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:58.065234 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b74dd-ccd5-464f-9bcc-ec1c1a249aca None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:58.066028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f490bc6-9f05-4d32-b52b-f6a9cf3c9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:58.066691 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f490bc6-9f05-4d32-b52b-f6a9cf3c9842 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:58.066975 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f490bc6-9f05-4d32-b52b-f6a9cf3c9842 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:58.067280 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f490bc6-9f05-4d32-b52b-f6a9cf3c9842 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:58.068018 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f490bc6-9f05-4d32-b52b-f6a9cf3c9842 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:58.068323 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f490bc6-9f05-4d32-b52b-f6a9cf3c9842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:58.069695 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f490bc6-9f05-4d32-b52b-f6a9cf3c9842 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:58.078638 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 228/449] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:56:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:58.084424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f490bc6-9f05-4d32-b52b-f6a9cf3c9842 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:58.165874 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b74dd-ccd5-464f-9bcc-ec1c1a249aca None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:58.186231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f490bc6-9f05-4d32-b52b-f6a9cf3c9842 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:58.200657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b575fc1-5031-4ddf-a8a0-f089579e7ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:58.201502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b575fc1-5031-4ddf-a8a0-f089579e7ab7 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:58.201785 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b575fc1-5031-4ddf-a8a0-f089579e7ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:58.202059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b575fc1-5031-4ddf-a8a0-f089579e7ab7 None admin] PATH_INFO: `/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:58.203245 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b575fc1-5031-4ddf-a8a0-f089579e7ab7 None admin] RBAC: Authorizing `identity:get_group(group_id=46db6b0d527a438ca10ea2fcd8fad39c)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:58.204686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b575fc1-5031-4ddf-a8a0-f089579e7ab7 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:58.206291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 222/450] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:58 2022] GET /identity/v3/groups/46db6b0d527a438ca10ea2fcd8fad39c => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:58.212987 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b575fc1-5031-4ddf-a8a0-f089579e7ab7 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:58.220384 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffac126-2e51-42a0-8a1b-680543d37c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:58.221033 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffac126-2e51-42a0-8a1b-680543d37c5f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:58.221319 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffac126-2e51-42a0-8a1b-680543d37c5f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:58.221596 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffac126-2e51-42a0-8a1b-680543d37c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:58.275004 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:58.275237 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:58.291663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffac126-2e51-42a0-8a1b-680543d37c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:58.293139 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffac126-2e51-42a0-8a1b-680543d37c5f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:58.315295 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b575fc1-5031-4ddf-a8a0-f089579e7ab7 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:58.350224 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98427037-3d9a-401e-ad87-da318c41cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:58.350963 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98427037-3d9a-401e-ad87-da318c41cc19 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:58.351344 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98427037-3d9a-401e-ad87-da318c41cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:58.351623 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98427037-3d9a-401e-ad87-da318c41cc19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:58.353033 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98427037-3d9a-401e-ad87-da318c41cc19 None admin] RBAC: Adding query filter params (group.id=46db6b0d527a438ca10ea2fcd8fad39c, role.id=65e129db80a94ccfba2808ee5768976e, scope.project.id=f2fc6165f0384fac8e876908e84085e2) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:58.353341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98427037-3d9a-401e-ad87-da318c41cc19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:58.354769 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98427037-3d9a-401e-ad87-da318c41cc19 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:58.360809 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 223/451] 10.222.0.98 () {56 vars in 1376 bytes} [Mon Jul 25 18:56:58 2022] GET /identity/v3/role_assignments?group.id=46db6b0d527a438ca10ea2fcd8fad39c&scope.project.id=f2fc6165f0384fac8e876908e84085e2&role.id=65e129db80a94ccfba2808ee5768976e => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:58.400659 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 229/452] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:58.406519 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98427037-3d9a-401e-ad87-da318c41cc19 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:58.511684 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98427037-3d9a-401e-ad87-da318c41cc19 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:58.538538 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:58.548388 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55f715-a960-46d8-a531-770bed9d7414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:58.549252 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55f715-a960-46d8-a531-770bed9d7414 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:58.549533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55f715-a960-46d8-a531-770bed9d7414 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:58.549805 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55f715-a960-46d8-a531-770bed9d7414 None admin] PATH_INFO: `/v3/projects/32aa335f68034a49832bdfc49717db33` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:58.550988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55f715-a960-46d8-a531-770bed9d7414 None admin] RBAC: Authorizing `identity:get_project(project_id=32aa335f68034a49832bdfc49717db33)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:58.552463 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55f715-a960-46d8-a531-770bed9d7414 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:58.554488 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 224/453] 10.222.0.98 () {56 vars in 1186 bytes} [Mon Jul 25 18:56:58 2022] GET /identity/v3/projects/32aa335f68034a49832bdfc49717db33 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:56:58.559956 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffac126-2e51-42a0-8a1b-680543d37c5f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:58.646828 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:58.667292 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffac126-2e51-42a0-8a1b-680543d37c5f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:58.704904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bec395-1b77-4041-9c19-85a9cd57491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:58.705767 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bec395-1b77-4041-9c19-85a9cd57491a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:58.706054 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bec395-1b77-4041-9c19-85a9cd57491a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:58.706329 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bec395-1b77-4041-9c19-85a9cd57491a None admin] PATH_INFO: `/v3/groups/d51133d4f0914150b2d8ba830942b430` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:58.707566 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bec395-1b77-4041-9c19-85a9cd57491a None admin] RBAC: Authorizing `identity:get_group(group_id=d51133d4f0914150b2d8ba830942b430)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:58.709021 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bec395-1b77-4041-9c19-85a9cd57491a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:58.710953 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 230/454] 10.222.0.98 () {56 vars in 1180 bytes} [Mon Jul 25 18:56:58 2022] GET /identity/v3/groups/d51133d4f0914150b2d8ba830942b430 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:56:58.716687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55f715-a960-46d8-a531-770bed9d7414 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:56:58.817594 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55f715-a960-46d8-a531-770bed9d7414 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:56:58.850289 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699eceb4-7df3-44c9-a859-b16468133279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:56:58.850926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699eceb4-7df3-44c9-a859-b16468133279 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:56:58.851232 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699eceb4-7df3-44c9-a859-b16468133279 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:56:58.851509 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699eceb4-7df3-44c9-a859-b16468133279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:56:58.852872 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699eceb4-7df3-44c9-a859-b16468133279 None admin] RBAC: Adding query filter params (group.id=d51133d4f0914150b2d8ba830942b430, role.id=472a286d91bd484a83e2de07fc231c06, scope.project.id=32aa335f68034a49832bdfc49717db33) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:56:58.853182 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699eceb4-7df3-44c9-a859-b16468133279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:56:58.854607 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699eceb4-7df3-44c9-a859-b16468133279 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:56:58.860442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 225/455] 10.222.0.98 () {56 vars in 1376 bytes} [Mon Jul 25 18:56:58 2022] GET /identity/v3/role_assignments?group.id=d51133d4f0914150b2d8ba830942b430&scope.project.id=32aa335f68034a49832bdfc49717db33&role.id=472a286d91bd484a83e2de07fc231c06 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:01.448541 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21b55-6168-4a17-aff7-a78ed16a38f7 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:01.449066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21b55-6168-4a17-aff7-a78ed16a38f7 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:01.449140 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21b55-6168-4a17-aff7-a78ed16a38f7 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:01.450779 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 231/456] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:01.456934 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee04b1-ef76-494c-824b-4c4c8065dc36 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:01.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee04b1-ef76-494c-824b-4c4c8065dc36 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:01.457508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee04b1-ef76-494c-824b-4c4c8065dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:01.478622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-72ee04b1-ef76-494c-824b-4c4c8065dc36 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:01.479872 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-72ee04b1-ef76-494c-824b-4c4c8065dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:01.545963 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:01.566523 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 226/457] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:01.595415 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21b55-6168-4a17-aff7-a78ed16a38f7 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:01.629370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d997ed4-a6fc-4d88-9088-4223fc4a6409 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:01.629978 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d997ed4-a6fc-4d88-9088-4223fc4a6409 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:01.630448 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d997ed4-a6fc-4d88-9088-4223fc4a6409 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:01.632549 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 227/458] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:01.639058 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898cb64-9a43-4304-9e3a-b9cae9c7938f None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:01.639634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898cb64-9a43-4304-9e3a-b9cae9c7938f None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:01.640125 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898cb64-9a43-4304-9e3a-b9cae9c7938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:01.659085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-6898cb64-9a43-4304-9e3a-b9cae9c7938f None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:01.660622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-6898cb64-9a43-4304-9e3a-b9cae9c7938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:01.714285 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21b55-6168-4a17-aff7-a78ed16a38f7 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:01.748079 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 228/459] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:57:01.748079 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597caf3f-5399-4ef8-bad2-4a75b25b07d1 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:01.748079 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597caf3f-5399-4ef8-bad2-4a75b25b07d1 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:01.748079 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597caf3f-5399-4ef8-bad2-4a75b25b07d1 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:01.748079 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 229/460] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:01.754176 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72d17-652f-45b5-a6c4-9d7dd1d64d81 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:01.754642 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72d17-652f-45b5-a6c4-9d7dd1d64d81 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:01.755085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72d17-652f-45b5-a6c4-9d7dd1d64d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:01.757516 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1fe65-43e1-49ad-8ae8-194ebf4fcde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:01.759057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1fe65-43e1-49ad-8ae8-194ebf4fcde1 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:01.759583 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1fe65-43e1-49ad-8ae8-194ebf4fcde1 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:01.759940 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1fe65-43e1-49ad-8ae8-194ebf4fcde1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:01.770881 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1fe65-43e1-49ad-8ae8-194ebf4fcde1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:01.772544 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1fe65-43e1-49ad-8ae8-194ebf4fcde1 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:01.775496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-d1e72d17-652f-45b5-a6c4-9d7dd1d64d81 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:01.776710 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-d1e72d17-652f-45b5-a6c4-9d7dd1d64d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-5fc1fe65-43e1-49ad-8ae8-194ebf4fcde1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:01.791658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:01.792886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:01.794169 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:01.794169 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:01.794169 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:01.794169 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:01.795996 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 232/461] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:01.796919 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1fe65-43e1-49ad-8ae8-194ebf4fcde1 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:01.804390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:01.854467 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 230/462] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:01.855715 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72d17-652f-45b5-a6c4-9d7dd1d64d81 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:01.918292 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:01.923496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1fe65-43e1-49ad-8ae8-194ebf4fcde1 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:01.960528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20789d66-1eb1-46bf-bcca-ab45350adb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:01.961322 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20789d66-1eb1-46bf-bcca-ab45350adb61 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:01.962242 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20789d66-1eb1-46bf-bcca-ab45350adb61 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:01.963027 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20789d66-1eb1-46bf-bcca-ab45350adb61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:01.974204 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20789d66-1eb1-46bf-bcca-ab45350adb61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:01.974343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72d17-652f-45b5-a6c4-9d7dd1d64d81 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:01.975644 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20789d66-1eb1-46bf-bcca-ab45350adb61 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-20789d66-1eb1-46bf-bcca-ab45350adb61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:01.995028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:01.996065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:01.996899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:01.996899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:01.996899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:01.996899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:02.000788 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 233/463] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:02.000788 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20789d66-1eb1-46bf-bcca-ab45350adb61 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:02.019443 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3cf7-24ec-4377-9106-5844a060f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:02.020116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3cf7-24ec-4377-9106-5844a060f228 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.020431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3cf7-24ec-4377-9106-5844a060f228 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.020714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3cf7-24ec-4377-9106-5844a060f228 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.021441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da3cf7-24ec-4377-9106-5844a060f228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:02.021757 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da3cf7-24ec-4377-9106-5844a060f228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:02.023139 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da3cf7-24ec-4377-9106-5844a060f228 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:02.037054 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 231/464] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:02.037054 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3cf7-24ec-4377-9106-5844a060f228 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:02.062028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:02.108344 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20789d66-1eb1-46bf-bcca-ab45350adb61 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:02.135754 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3cf7-24ec-4377-9106-5844a060f228 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:02.143781 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b2d08-17c4-49a9-8c65-de321c393e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:02.144444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:02.145120 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2d08-17c4-49a9-8c65-de321c393e0d None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.145301 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2d08-17c4-49a9-8c65-de321c393e0d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.145452 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2d08-17c4-49a9-8c65-de321c393e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.156976 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b2d08-17c4-49a9-8c65-de321c393e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:02.158442 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b2d08-17c4-49a9-8c65-de321c393e0d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:02.170628 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42463792-1ba2-4e34-9a01-ca6adfe18d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:02.171312 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463792-1ba2-4e34-9a01-ca6adfe18d78 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.171604 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463792-1ba2-4e34-9a01-ca6adfe18d78 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.171895 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463792-1ba2-4e34-9a01-ca6adfe18d78 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.172588 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42463792-1ba2-4e34-9a01-ca6adfe18d78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:02.172893 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42463792-1ba2-4e34-9a01-ca6adfe18d78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:02.174233 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42463792-1ba2-4e34-9a01-ca6adfe18d78 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-152b2d08-17c4-49a9-8c65-de321c393e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:02.175988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:02.176812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:02.177721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:02.177721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:02.177721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:02.177721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:02.177721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 234/465] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:02.178807 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af75b52-fe11-457a-b46c-fbc51a690080 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.179206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af75b52-fe11-457a-b46c-fbc51a690080 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.179424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af75b52-fe11-457a-b46c-fbc51a690080 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.180878 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 235/466] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:02.181701 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af75b52-fe11-457a-b46c-fbc51a690080 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:02.194551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 232/467] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:02.195887 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014a0a-002b-4e33-9ad7-ea0b71ef833e None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.196292 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014a0a-002b-4e33-9ad7-ea0b71ef833e None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.196699 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014a0a-002b-4e33-9ad7-ea0b71ef833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.214820 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-0b014a0a-002b-4e33-9ad7-ea0b71ef833e None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:02.216056 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-0b014a0a-002b-4e33-9ad7-ea0b71ef833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:02.282799 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 233/468] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:02.283442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b014a0a-002b-4e33-9ad7-ea0b71ef833e None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:02.290688 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af75b52-fe11-457a-b46c-fbc51a690080 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:02.303301 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:02.330445 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68e654-4303-4040-a1cd-0d1c020e3f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:02.331242 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68e654-4303-4040-a1cd-0d1c020e3f25 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.331529 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68e654-4303-4040-a1cd-0d1c020e3f25 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.331799 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68e654-4303-4040-a1cd-0d1c020e3f25 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.332496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68e654-4303-4040-a1cd-0d1c020e3f25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:02.333931 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68e654-4303-4040-a1cd-0d1c020e3f25 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:02.355443 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 236/469] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:57:02 2022] POST /identity/v3/users => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:02.356320 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68e654-4303-4040-a1cd-0d1c020e3f25 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:02.388468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:02.393901 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b014a0a-002b-4e33-9ad7-ea0b71ef833e None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:02.435276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c8afe-0455-42d4-a9c7-84f2bc53039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:02.436071 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c8afe-0455-42d4-a9c7-84f2bc53039c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.436351 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c8afe-0455-42d4-a9c7-84f2bc53039c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.436738 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c8afe-0455-42d4-a9c7-84f2bc53039c None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.437475 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c8afe-0455-42d4-a9c7-84f2bc53039c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:02.437780 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c8afe-0455-42d4-a9c7-84f2bc53039c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:02.439258 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c8afe-0455-42d4-a9c7-84f2bc53039c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:02.453438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 234/470] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:02.454222 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c8afe-0455-42d4-a9c7-84f2bc53039c None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:02.476284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68e654-4303-4040-a1cd-0d1c020e3f25 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:02.518020 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd208163-076e-4f97-b48c-4beb393e9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:02.518712 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd208163-076e-4f97-b48c-4beb393e9647 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.519004 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd208163-076e-4f97-b48c-4beb393e9647 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.519335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd208163-076e-4f97-b48c-4beb393e9647 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.520045 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd208163-076e-4f97-b48c-4beb393e9647 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:02.521524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd208163-076e-4f97-b48c-4beb393e9647 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:02.551240 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 237/471] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:57:02 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:02.551240 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd208163-076e-4f97-b48c-4beb393e9647 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:02.583264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:02.585826 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c8afe-0455-42d4-a9c7-84f2bc53039c None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:02.636502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3aaa4-f605-486d-8c8e-55267015ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:02.637329 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3aaa4-f605-486d-8c8e-55267015ac1d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.637624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3aaa4-f605-486d-8c8e-55267015ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.637876 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3aaa4-f605-486d-8c8e-55267015ac1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.653878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3aaa4-f605-486d-8c8e-55267015ac1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:02.655699 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3aaa4-f605-486d-8c8e-55267015ac1d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-60d3aaa4-f605-486d-8c8e-55267015ac1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:02.681502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:02.682422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:02.683307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:02.683307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:02.683307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:02.683307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:02.687754 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 235/472] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:02.690342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3aaa4-f605-486d-8c8e-55267015ac1d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:02.704898 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd208163-076e-4f97-b48c-4beb393e9647 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:02.729849 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:02.746690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9f8f-3e83-49bf-af52-fb671bb92749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:02.747505 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9f8f-3e83-49bf-af52-fb671bb92749 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.747788 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9f8f-3e83-49bf-af52-fb671bb92749 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.748060 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9f8f-3e83-49bf-af52-fb671bb92749 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.748764 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be9f8f-3e83-49bf-af52-fb671bb92749 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:02.750203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be9f8f-3e83-49bf-af52-fb671bb92749 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:02.773740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 238/473] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:57:02 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:02.820977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3aaa4-f605-486d-8c8e-55267015ac1d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:02.865640 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d2149-be8c-417f-a7b1-26eee23f2169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:02.866311 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2149-be8c-417f-a7b1-26eee23f2169 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:02.866648 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2149-be8c-417f-a7b1-26eee23f2169 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:02.866930 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2149-be8c-417f-a7b1-26eee23f2169 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:02.867796 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d2149-be8c-417f-a7b1-26eee23f2169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:02.869312 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d2149-be8c-417f-a7b1-26eee23f2169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:02.870758 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d2149-be8c-417f-a7b1-26eee23f2169 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:02.889107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 236/474] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:02.892155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9f8f-3e83-49bf-af52-fb671bb92749 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:02.989918 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:03.016042 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9f8f-3e83-49bf-af52-fb671bb92749 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:03.053486 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c433f90-3642-4511-ae96-2b3f4866a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:03.054328 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c433f90-3642-4511-ae96-2b3f4866a48f None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:03.054737 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c433f90-3642-4511-ae96-2b3f4866a48f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:03.055120 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c433f90-3642-4511-ae96-2b3f4866a48f None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:03.056001 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c433f90-3642-4511-ae96-2b3f4866a48f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:03.057579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c433f90-3642-4511-ae96-2b3f4866a48f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:03.081925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 239/475] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:57:02 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:04.825279 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2848c-1d72-4f43-88c5-a9790e8bddf0 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:04.825797 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2848c-1d72-4f43-88c5-a9790e8bddf0 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:04.825920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2848c-1d72-4f43-88c5-a9790e8bddf0 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:04.827698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 237/476] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:04.832962 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ec3a3-aa0c-447c-bda8-acda840602b1 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:04.833370 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ec3a3-aa0c-447c-bda8-acda840602b1 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:04.833523 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ec3a3-aa0c-447c-bda8-acda840602b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:04.854135 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-d97ec3a3-aa0c-447c-bda8-acda840602b1 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:04.855352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-d97ec3a3-aa0c-447c-bda8-acda840602b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:05.005892 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 240/477] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:05.031975 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2848c-1d72-4f43-88c5-a9790e8bddf0 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:05.107440 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:05.126981 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a995250-47d8-4765-b8f4-17812d0ec4ba None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.127510 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a995250-47d8-4765-b8f4-17812d0ec4ba None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.127617 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a995250-47d8-4765-b8f4-17812d0ec4ba None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.128942 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 241/478] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:05.135645 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875128-8c42-4541-ab5c-5a1e9f85b2ae None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.135933 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875128-8c42-4541-ab5c-5a1e9f85b2ae None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.136210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875128-8c42-4541-ab5c-5a1e9f85b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.145159 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2848c-1d72-4f43-88c5-a9790e8bddf0 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:05.154588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-2a875128-8c42-4541-ab5c-5a1e9f85b2ae None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:05.155837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-2a875128-8c42-4541-ab5c-5a1e9f85b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:05.191428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f85c15-4e7c-472f-86db-b5947638778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:05.192328 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f85c15-4e7c-472f-86db-b5947638778d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.192625 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f85c15-4e7c-472f-86db-b5947638778d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.192903 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f85c15-4e7c-472f-86db-b5947638778d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.206640 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f85c15-4e7c-472f-86db-b5947638778d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-36f85c15-4e7c-472f-86db-b5947638778d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:05.214926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:05.215997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:05.216881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 238/479] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:05.217556 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190dfb-0a91-4c5d-91cb-a46d57f6c26c None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.217681 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190dfb-0a91-4c5d-91cb-a46d57f6c26c None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.218670 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190dfb-0a91-4c5d-91cb-a46d57f6c26c None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.219160 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 239/480] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:05.222986 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:05.224240 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61190dfb-0a91-4c5d-91cb-a46d57f6c26c None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:05.243181 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 242/481] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:57:05.243181 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1843-c89b-49fd-8613-e897f6d72eaf None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.243181 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1843-c89b-49fd-8613-e897f6d72eaf None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.243181 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1843-c89b-49fd-8613-e897f6d72eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.260033 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-6dcd1843-c89b-49fd-8613-e897f6d72eaf None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:05.261189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-6dcd1843-c89b-49fd-8613-e897f6d72eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:05.333822 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 243/482] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:05.334496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd1843-c89b-49fd-8613-e897f6d72eaf None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:05.362198 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61190dfb-0a91-4c5d-91cb-a46d57f6c26c None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:05.396237 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:05.404508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21fc7a-bafb-40e3-a455-c010abcdc673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:05.405170 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21fc7a-bafb-40e3-a455-c010abcdc673 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.405455 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21fc7a-bafb-40e3-a455-c010abcdc673 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.405736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21fc7a-bafb-40e3-a455-c010abcdc673 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.406488 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21fc7a-bafb-40e3-a455-c010abcdc673 None admin] RBAC: Adding query filter params (name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:05.406794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21fc7a-bafb-40e3-a455-c010abcdc673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:05.408230 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21fc7a-bafb-40e3-a455-c010abcdc673 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:05.422666 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 240/483] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:05.422666 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21fc7a-bafb-40e3-a455-c010abcdc673 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:05.453776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd1843-c89b-49fd-8613-e897f6d72eaf None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:05.480110 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:05.494663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4d093-b454-4bf4-83db-e0db27287e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:05.495592 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d093-b454-4bf4-83db-e0db27287e06 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.495885 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d093-b454-4bf4-83db-e0db27287e06 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.496163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d093-b454-4bf4-83db-e0db27287e06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.509824 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4d093-b454-4bf4-83db-e0db27287e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-13b4d093-b454-4bf4-83db-e0db27287e06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:05.518588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:05.519666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 244/484] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:05.526563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4d093-b454-4bf4-83db-e0db27287e06 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:05.531434 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21fc7a-bafb-40e3-a455-c010abcdc673 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:05.571946 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1476b-6b21-40b8-90b9-89803bc145d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:05.573470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1476b-6b21-40b8-90b9-89803bc145d0 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.573999 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1476b-6b21-40b8-90b9-89803bc145d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.574380 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1476b-6b21-40b8-90b9-89803bc145d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.586002 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1476b-6b21-40b8-90b9-89803bc145d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-6cd1476b-6b21-40b8-90b9-89803bc145d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:05.595060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:05.595974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:05.596767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 241/485] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:05.597424 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1476b-6b21-40b8-90b9-89803bc145d0 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:05.638169 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4d093-b454-4bf4-83db-e0db27287e06 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:05.656830 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:05.672719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567cd5-807a-40a2-a791-98aff00ede7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:05.673512 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567cd5-807a-40a2-a791-98aff00ede7b None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.673794 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567cd5-807a-40a2-a791-98aff00ede7b None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.674115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567cd5-807a-40a2-a791-98aff00ede7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.686911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7567cd5-807a-40a2-a791-98aff00ede7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:05.688456 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7567cd5-807a-40a2-a791-98aff00ede7b None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-c7567cd5-807a-40a2-a791-98aff00ede7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:05.707714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:05.708719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:05.709618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:05.709618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:05.709618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:05.709618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:05.709833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1476b-6b21-40b8-90b9-89803bc145d0 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:05.709904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 245/486] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:05.709904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567cd5-807a-40a2-a791-98aff00ede7b None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:05.744803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:05.748614 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07ed73-0f28-41a1-9f42-4949f7153f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:05.749353 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07ed73-0f28-41a1-9f42-4949f7153f7c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.749638 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07ed73-0f28-41a1-9f42-4949f7153f7c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.749917 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07ed73-0f28-41a1-9f42-4949f7153f7c None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.750656 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07ed73-0f28-41a1-9f42-4949f7153f7c None admin] RBAC: Adding query filter params (name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:05.750965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07ed73-0f28-41a1-9f42-4949f7153f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:05.752370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07ed73-0f28-41a1-9f42-4949f7153f7c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:05.761317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 242/487] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:05.762558 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1b0f-4279-489b-9856-5a33de86dbaa None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.762852 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1b0f-4279-489b-9856-5a33de86dbaa None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.763146 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1b0f-4279-489b-9856-5a33de86dbaa None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.764363 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 243/488] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:05.765053 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1b0f-4279-489b-9856-5a33de86dbaa None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:05.818505 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567cd5-807a-40a2-a791-98aff00ede7b None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:05.853681 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ece95-bf8b-4523-a416-88cc5738f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:05.854421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ece95-bf8b-4523-a416-88cc5738f918 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.854733 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ece95-bf8b-4523-a416-88cc5738f918 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.854885 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ece95-bf8b-4523-a416-88cc5738f918 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.855650 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ece95-bf8b-4523-a416-88cc5738f918 None admin] RBAC: Adding query filter params (name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:05.855959 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ece95-bf8b-4523-a416-88cc5738f918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:05.857369 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ece95-bf8b-4523-a416-88cc5738f918 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:05.865309 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 246/489] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:05.866079 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ece95-bf8b-4523-a416-88cc5738f918 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:05.872052 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1b0f-4279-489b-9856-5a33de86dbaa None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:05.886569 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:05.911402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8507c-ada3-49b3-9d32-1f83d6d75243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:05.912472 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8507c-ada3-49b3-9d32-1f83d6d75243 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.912761 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8507c-ada3-49b3-9d32-1f83d6d75243 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.913122 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8507c-ada3-49b3-9d32-1f83d6d75243 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.913959 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8507c-ada3-49b3-9d32-1f83d6d75243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:05.914268 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8507c-ada3-49b3-9d32-1f83d6d75243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:05.915892 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8507c-ada3-49b3-9d32-1f83d6d75243 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:05.928476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 244/490] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:05.928476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511ac59-91a4-464f-b713-dddc9a387782 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:05.928476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511ac59-91a4-464f-b713-dddc9a387782 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:05.928476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511ac59-91a4-464f-b713-dddc9a387782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:05.951174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-e511ac59-91a4-464f-b713-dddc9a387782 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:05.952398 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-e511ac59-91a4-464f-b713-dddc9a387782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:05.973706 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:05.980272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ece95-bf8b-4523-a416-88cc5738f918 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.014911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455df31-0baf-4cfa-9c59-5b512a40d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.015752 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455df31-0baf-4cfa-9c59-5b512a40d480 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.016043 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455df31-0baf-4cfa-9c59-5b512a40d480 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.016321 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455df31-0baf-4cfa-9c59-5b512a40d480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.021193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 245/491] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:06.022039 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511ac59-91a4-464f-b713-dddc9a387782 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.027970 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455df31-0baf-4cfa-9c59-5b512a40d480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.029452 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455df31-0baf-4cfa-9c59-5b512a40d480 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-a455df31-0baf-4cfa-9c59-5b512a40d480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:06.048719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:06.049612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:06.050479 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:06.050479 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:06.050479 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:06.050479 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:06.050479 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 247/492] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:06.050762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455df31-0baf-4cfa-9c59-5b512a40d480 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.126455 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511ac59-91a4-464f-b713-dddc9a387782 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.128990 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:06.153155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455df31-0baf-4cfa-9c59-5b512a40d480 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.162613 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb2829-9598-4046-b661-71a5ab6095d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.163431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb2829-9598-4046-b661-71a5ab6095d1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.163735 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb2829-9598-4046-b661-71a5ab6095d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.164007 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb2829-9598-4046-b661-71a5ab6095d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.174840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb2829-9598-4046-b661-71a5ab6095d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.176320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb2829-9598-4046-b661-71a5ab6095d1 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:06.187762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9539d-8ca3-408c-9152-16d974e41063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.188541 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9539d-8ca3-408c-9152-16d974e41063 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.188822 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9539d-8ca3-408c-9152-16d974e41063 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.189094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9539d-8ca3-408c-9152-16d974e41063 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-ddfb2829-9598-4046-b661-71a5ab6095d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:06.194731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:06.195870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:06.197204 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:06.197204 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:06.197204 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:06.197204 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:06.197204 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 246/493] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:06.197204 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb2829-9598-4046-b661-71a5ab6095d1 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.201666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9539d-8ca3-408c-9152-16d974e41063 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.203137 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9539d-8ca3-408c-9152-16d974e41063 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-9ce9539d-8ca3-408c-9152-16d974e41063 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:06.221666 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:06.222614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:06.223522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 248/494] 10.222.0.98 () {56 vars in 1093 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:06.224396 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9539d-8ca3-408c-9152-16d974e41063 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.241191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:06.302295 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb2829-9598-4046-b661-71a5ab6095d1 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.334692 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9539d-8ca3-408c-9152-16d974e41063 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.337515 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faf473-41c2-4054-a499-7b31c5c1f0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.338321 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faf473-41c2-4054-a499-7b31c5c1f0a1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.338627 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faf473-41c2-4054-a499-7b31c5c1f0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.338900 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faf473-41c2-4054-a499-7b31c5c1f0a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.349316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0faf473-41c2-4054-a499-7b31c5c1f0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-b0faf473-41c2-4054-a499-7b31c5c1f0a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:06.357303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:06.358381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 247/495] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:06.359362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faf473-41c2-4054-a499-7b31c5c1f0a1 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.371878 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff1d0b-f9aa-42c4-bf9b-4b0a2b57403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.372693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff1d0b-f9aa-42c4-bf9b-4b0a2b57403a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.372978 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff1d0b-f9aa-42c4-bf9b-4b0a2b57403a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.373252 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff1d0b-f9aa-42c4-bf9b-4b0a2b57403a None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.373972 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff1d0b-f9aa-42c4-bf9b-4b0a2b57403a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:06.374284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff1d0b-f9aa-42c4-bf9b-4b0a2b57403a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.375696 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff1d0b-f9aa-42c4-bf9b-4b0a2b57403a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:06.377017 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:06.393701 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 249/496] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:06.394524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff1d0b-f9aa-42c4-bf9b-4b0a2b57403a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.461106 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:06.468223 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faf473-41c2-4054-a499-7b31c5c1f0a1 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.495460 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff1d0b-f9aa-42c4-bf9b-4b0a2b57403a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.501438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19d187-2870-4fa6-a125-dfc2122e18f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.502097 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19d187-2870-4fa6-a125-dfc2122e18f4 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.502386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19d187-2870-4fa6-a125-dfc2122e18f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.502666 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19d187-2870-4fa6-a125-dfc2122e18f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.503427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19d187-2870-4fa6-a125-dfc2122e18f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:06.503740 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19d187-2870-4fa6-a125-dfc2122e18f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.505108 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19d187-2870-4fa6-a125-dfc2122e18f4 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:06.516907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 248/497] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:06.517702 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19d187-2870-4fa6-a125-dfc2122e18f4 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.530768 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8eb0f9-fe79-42d8-8feb-2b6a83c389fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.531471 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb0f9-fe79-42d8-8feb-2b6a83c389fb None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.531762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb0f9-fe79-42d8-8feb-2b6a83c389fb None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.532044 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb0f9-fe79-42d8-8feb-2b6a83c389fb None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.532880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8eb0f9-fe79-42d8-8feb-2b6a83c389fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:06.533197 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8eb0f9-fe79-42d8-8feb-2b6a83c389fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.534662 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8eb0f9-fe79-42d8-8feb-2b6a83c389fb None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:06.570484 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 250/498] 10.222.0.98 () {56 vars in 1133 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:06.571594 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8eb0f9-fe79-42d8-8feb-2b6a83c389fb None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.594261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:06.617202 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19d187-2870-4fa6-a125-dfc2122e18f4 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.652348 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7feca-c561-484e-a8cd-b35ae8d52a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.653186 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7feca-c561-484e-a8cd-b35ae8d52a64 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.653556 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7feca-c561-484e-a8cd-b35ae8d52a64 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.653846 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7feca-c561-484e-a8cd-b35ae8d52a64 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.654587 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7feca-c561-484e-a8cd-b35ae8d52a64 None admin] RBAC: Adding query filter params (name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:06.654893 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7feca-c561-484e-a8cd-b35ae8d52a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.656298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7feca-c561-484e-a8cd-b35ae8d52a64 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:06.666136 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 249/499] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:06.666933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7feca-c561-484e-a8cd-b35ae8d52a64 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.685949 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8eb0f9-fe79-42d8-8feb-2b6a83c389fb None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.712000 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:06.721241 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16dfa4-e979-4179-bb6c-823737c6033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.722035 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16dfa4-e979-4179-bb6c-823737c6033e None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.722322 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16dfa4-e979-4179-bb6c-823737c6033e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.722597 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16dfa4-e979-4179-bb6c-823737c6033e None admin] PATH_INFO: `/v3/users/glance` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.730548 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16dfa4-e979-4179-bb6c-823737c6033e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.732134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16dfa4-e979-4179-bb6c-823737c6033e None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-db16dfa4-e979-4179-bb6c-823737c6033e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:06.746698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:06.747721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:06.748616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 251/500] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:06.749168 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16dfa4-e979-4179-bb6c-823737c6033e None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.770161 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7feca-c561-484e-a8cd-b35ae8d52a64 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.804643 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291c92d-b9e3-4f23-9f6c-0eabdb6804ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.805678 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291c92d-b9e3-4f23-9f6c-0eabdb6804ce None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.805972 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291c92d-b9e3-4f23-9f6c-0eabdb6804ce None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.806251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291c92d-b9e3-4f23-9f6c-0eabdb6804ce None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.813936 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291c92d-b9e3-4f23-9f6c-0eabdb6804ce None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.815430 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291c92d-b9e3-4f23-9f6c-0eabdb6804ce None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:06.817312 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-8291c92d-b9e3-4f23-9f6c-0eabdb6804ce None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:06.832988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:06.833933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 250/501] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:06.835048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291c92d-b9e3-4f23-9f6c-0eabdb6804ce None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:06.856388 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16dfa4-e979-4179-bb6c-823737c6033e None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.890259 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1726287-935d-4968-8b15-74268f809fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.890906 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1726287-935d-4968-8b15-74268f809fea None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.891228 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1726287-935d-4968-8b15-74268f809fea None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.891510 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1726287-935d-4968-8b15-74268f809fea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.938793 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291c92d-b9e3-4f23-9f6c-0eabdb6804ce None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:06.947601 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:06.962084 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1726287-935d-4968-8b15-74268f809fea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.963657 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1726287-935d-4968-8b15-74268f809fea None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:06.973348 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fe41a-110c-4ac0-970c-d22dfb0b8bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:06.974134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fe41a-110c-4ac0-970c-d22dfb0b8bdd None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:06.974414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fe41a-110c-4ac0-970c-d22dfb0b8bdd None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:06.974694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fe41a-110c-4ac0-970c-d22dfb0b8bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:06.985741 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fe41a-110c-4ac0-970c-d22dfb0b8bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:06.987200 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fe41a-110c-4ac0-970c-d22dfb0b8bdd None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-5c4fe41a-110c-4ac0-970c-d22dfb0b8bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:07.006155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:07.007352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:07.009003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:07.009003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:07.009003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:07.009003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:07.009003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 251/502] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:07.009409 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fe41a-110c-4ac0-970c-d22dfb0b8bdd None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:07.060210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:07.068185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 252/503] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:57:07.069019 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1726287-935d-4968-8b15-74268f809fea None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:07.115896 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fe41a-110c-4ac0-970c-d22dfb0b8bdd None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:07.151064 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f6f4d-b0d0-457e-a933-877d7bb2fbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:07.151757 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f6f4d-b0d0-457e-a933-877d7bb2fbfc None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:07.152045 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f6f4d-b0d0-457e-a933-877d7bb2fbfc None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:07.152326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f6f4d-b0d0-457e-a933-877d7bb2fbfc None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:07.153155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f6f4d-b0d0-457e-a933-877d7bb2fbfc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:07.153473 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f6f4d-b0d0-457e-a933-877d7bb2fbfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:07.154902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f6f4d-b0d0-457e-a933-877d7bb2fbfc None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:07.156843 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:07.172016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1726287-935d-4968-8b15-74268f809fea None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:07.191799 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 252/504] 10.222.0.98 () {56 vars in 1137 bytes} [Mon Jul 25 18:57:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:07.192963 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f6f4d-b0d0-457e-a933-877d7bb2fbfc None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:07.206785 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c6542-4347-4932-b11c-c4c08a22550d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:07.207485 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c6542-4347-4932-b11c-c4c08a22550d None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:07.207772 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c6542-4347-4932-b11c-c4c08a22550d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:07.208053 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c6542-4347-4932-b11c-c4c08a22550d None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:07.208889 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c6542-4347-4932-b11c-c4c08a22550d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:07.209200 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c6542-4347-4932-b11c-c4c08a22550d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:07.210917 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c6542-4347-4932-b11c-c4c08a22550d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:07.227868 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 253/505] 10.222.0.98 () {56 vars in 1137 bytes} [Mon Jul 25 18:57:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:07.228482 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c6542-4347-4932-b11c-c4c08a22550d None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:07.300967 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f6f4d-b0d0-457e-a933-877d7bb2fbfc None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:07.311743 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:07.329282 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c6542-4347-4932-b11c-c4c08a22550d None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:07.336924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473bd6e-f36c-4d5e-aaa7-2b082fb3c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:07.337581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473bd6e-f36c-4d5e-aaa7-2b082fb3c731 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:07.337866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473bd6e-f36c-4d5e-aaa7-2b082fb3c731 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:07.338141 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473bd6e-f36c-4d5e-aaa7-2b082fb3c731 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:07.338854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473bd6e-f36c-4d5e-aaa7-2b082fb3c731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:07.339247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473bd6e-f36c-4d5e-aaa7-2b082fb3c731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:07.340618 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473bd6e-f36c-4d5e-aaa7-2b082fb3c731 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:07.351630 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 253/506] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:07.352433 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473bd6e-f36c-4d5e-aaa7-2b082fb3c731 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:07.368488 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e4e58-2cd6-4192-a0d0-6d04e0ae272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:07.369313 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e4e58-2cd6-4192-a0d0-6d04e0ae272c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:07.369598 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e4e58-2cd6-4192-a0d0-6d04e0ae272c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:07.369872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e4e58-2cd6-4192-a0d0-6d04e0ae272c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:07.380121 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e4e58-2cd6-4192-a0d0-6d04e0ae272c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:07.381578 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e4e58-2cd6-4192-a0d0-6d04e0ae272c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:07.385000 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-848e4e58-2cd6-4192-a0d0-6d04e0ae272c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:07.401206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:07.402244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:07.403405 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:07.403405 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:07.403405 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:07.403405 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:07.408308 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 254/507] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:07.409461 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e4e58-2cd6-4192-a0d0-6d04e0ae272c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:07.454821 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473bd6e-f36c-4d5e-aaa7-2b082fb3c731 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:07.489078 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034c5bb-21bb-4649-88c0-3369a2648e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:07.489712 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c5bb-21bb-4649-88c0-3369a2648e56 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:07.489995 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c5bb-21bb-4649-88c0-3369a2648e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:07.490266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c5bb-21bb-4649-88c0-3369a2648e56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:07.511857 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e4e58-2cd6-4192-a0d0-6d04e0ae272c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:07.526040 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:07.546637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96fe6d-82e4-4bdf-97cc-5f94f87ab843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:07.547312 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96fe6d-82e4-4bdf-97cc-5f94f87ab843 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:07.547596 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96fe6d-82e4-4bdf-97cc-5f94f87ab843 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:07.547869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96fe6d-82e4-4bdf-97cc-5f94f87ab843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:07.561673 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034c5bb-21bb-4649-88c0-3369a2648e56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:07.563240 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034c5bb-21bb-4649-88c0-3369a2648e56 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:07.609593 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:07.616386 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96fe6d-82e4-4bdf-97cc-5f94f87ab843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:07.618670 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96fe6d-82e4-4bdf-97cc-5f94f87ab843 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:07.667213 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 254/508] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:57:07.668063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034c5bb-21bb-4649-88c0-3369a2648e56 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:07.723756 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 255/509] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:57:07.724525 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96fe6d-82e4-4bdf-97cc-5f94f87ab843 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:07.736837 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:07.770921 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034c5bb-21bb-4649-88c0-3369a2648e56 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:07.804001 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b81240-6b61-4a59-83f4-1dd381034d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:07.804777 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b81240-6b61-4a59-83f4-1dd381034d9a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:07.805121 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b81240-6b61-4a59-83f4-1dd381034d9a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:07.806229 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b81240-6b61-4a59-83f4-1dd381034d9a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:07.813023 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b81240-6b61-4a59-83f4-1dd381034d9a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:07.814453 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b81240-6b61-4a59-83f4-1dd381034d9a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:07.818579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:07.824939 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96fe6d-82e4-4bdf-97cc-5f94f87ab843 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-16b81240-6b61-4a59-83f4-1dd381034d9a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:07.829403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:07.830259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:07.831155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 255/510] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:07.831711 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b81240-6b61-4a59-83f4-1dd381034d9a None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:07.859731 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096d062-468e-4407-b042-65568eafad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:07.860386 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d062-468e-4407-b042-65568eafad64 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:07.860669 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d062-468e-4407-b042-65568eafad64 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:07.860942 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d062-468e-4407-b042-65568eafad64 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:07.861662 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d062-468e-4407-b042-65568eafad64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:07.861968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d062-468e-4407-b042-65568eafad64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:07.863384 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d062-468e-4407-b042-65568eafad64 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:07.875435 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 256/511] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:07.876217 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096d062-468e-4407-b042-65568eafad64 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:07.935362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b81240-6b61-4a59-83f4-1dd381034d9a None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:07.964281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:07.972608 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c67b7e-693b-4b37-a546-0c15a6d9082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:07.973395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c67b7e-693b-4b37-a546-0c15a6d9082e None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:07.973676 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c67b7e-693b-4b37-a546-0c15a6d9082e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:07.974006 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c67b7e-693b-4b37-a546-0c15a6d9082e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:07.980859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096d062-468e-4407-b042-65568eafad64 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:07.984944 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c67b7e-693b-4b37-a546-0c15a6d9082e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:07.986455 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c67b7e-693b-4b37-a546-0c15a6d9082e None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-71c67b7e-693b-4b37-a546-0c15a6d9082e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:08.004832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:08.005687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:08.006535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:08.006535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:08.006535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:08.006535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:08.006535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 256/512] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:08.006800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c67b7e-693b-4b37-a546-0c15a6d9082e None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.016361 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c13e3-831e-4721-93f0-21be2591840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.017144 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c13e3-831e-4721-93f0-21be2591840c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.017428 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c13e3-831e-4721-93f0-21be2591840c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.017700 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c13e3-831e-4721-93f0-21be2591840c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.029202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c13e3-831e-4721-93f0-21be2591840c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.030684 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c13e3-831e-4721-93f0-21be2591840c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-e20c13e3-831e-4721-93f0-21be2591840c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:08.047911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:08.048789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:08.049635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:08.049635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:08.049635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:08.049635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:08.049635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 257/513] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:08.050223 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c13e3-831e-4721-93f0-21be2591840c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.061941 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:08.119052 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c67b7e-693b-4b37-a546-0c15a6d9082e None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.150593 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c13e3-831e-4721-93f0-21be2591840c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.153613 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a82e9-b3a9-49cb-90d2-8cb4b63a04e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.154283 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a82e9-b3a9-49cb-90d2-8cb4b63a04e7 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.154615 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a82e9-b3a9-49cb-90d2-8cb4b63a04e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.154851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a82e9-b3a9-49cb-90d2-8cb4b63a04e7 None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.155831 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a82e9-b3a9-49cb-90d2-8cb4b63a04e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:08.156152 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a82e9-b3a9-49cb-90d2-8cb4b63a04e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.157603 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a82e9-b3a9-49cb-90d2-8cb4b63a04e7 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.174995 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 257/514] 10.222.0.98 () {56 vars in 1139 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:08.175837 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a82e9-b3a9-49cb-90d2-8cb4b63a04e7 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.184598 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c70e3-e74d-4f07-972b-2e27d46cf1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.185394 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c70e3-e74d-4f07-972b-2e27d46cf1b6 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.185680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c70e3-e74d-4f07-972b-2e27d46cf1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.185957 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c70e3-e74d-4f07-972b-2e27d46cf1b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.192601 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c70e3-e74d-4f07-972b-2e27d46cf1b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.194050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c70e3-e74d-4f07-972b-2e27d46cf1b6 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-447c70e3-e74d-4f07-972b-2e27d46cf1b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:08.209191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:08.210188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:08.211061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:08.211061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:08.211061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:08.211061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:08.211061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:08.211061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:08.211061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:08.211061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:08.211061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 258/515] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:08.212178 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c70e3-e74d-4f07-972b-2e27d46cf1b6 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.222355 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:08.280139 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:08.286972 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a82e9-b3a9-49cb-90d2-8cb4b63a04e7 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.314847 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c70e3-e74d-4f07-972b-2e27d46cf1b6 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.323412 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a657f0-2bfd-4f31-a3e2-8930509c50ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.324070 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a657f0-2bfd-4f31-a3e2-8930509c50ea None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.324359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a657f0-2bfd-4f31-a3e2-8930509c50ea None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.324635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a657f0-2bfd-4f31-a3e2-8930509c50ea None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.325348 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a657f0-2bfd-4f31-a3e2-8930509c50ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:08.325657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a657f0-2bfd-4f31-a3e2-8930509c50ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.327043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a657f0-2bfd-4f31-a3e2-8930509c50ea None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.338630 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 258/516] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:08.339469 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a657f0-2bfd-4f31-a3e2-8930509c50ea None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.350011 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e511f-4086-4c6c-bb96-275cc8d9efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.350670 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e511f-4086-4c6c-bb96-275cc8d9efcc None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.350950 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e511f-4086-4c6c-bb96-275cc8d9efcc None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.351259 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e511f-4086-4c6c-bb96-275cc8d9efcc None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.352010 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e511f-4086-4c6c-bb96-275cc8d9efcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:08.352312 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e511f-4086-4c6c-bb96-275cc8d9efcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.353687 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e511f-4086-4c6c-bb96-275cc8d9efcc None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.365621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 259/517] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:08.366399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e511f-4086-4c6c-bb96-275cc8d9efcc None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.436604 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:08.440732 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a657f0-2bfd-4f31-a3e2-8930509c50ea None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.471515 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e511f-4086-4c6c-bb96-275cc8d9efcc None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.474603 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f370f-a854-4e37-b539-5436d4042957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.475287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f370f-a854-4e37-b539-5436d4042957 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.475573 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f370f-a854-4e37-b539-5436d4042957 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.475849 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f370f-a854-4e37-b539-5436d4042957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.497608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:08.505776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d397e94-1aab-466e-8ee9-7b9937209023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.506547 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397e94-1aab-466e-8ee9-7b9937209023 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.506904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397e94-1aab-466e-8ee9-7b9937209023 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.507494 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397e94-1aab-466e-8ee9-7b9937209023 None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.508787 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d397e94-1aab-466e-8ee9-7b9937209023 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:08.509100 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d397e94-1aab-466e-8ee9-7b9937209023 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.510547 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d397e94-1aab-466e-8ee9-7b9937209023 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.528826 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 260/518] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:08.529648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d397e94-1aab-466e-8ee9-7b9937209023 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.546461 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f370f-a854-4e37-b539-5436d4042957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.547879 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f370f-a854-4e37-b539-5436d4042957 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.637643 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d397e94-1aab-466e-8ee9-7b9937209023 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.643425 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:08.648233 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 259/519] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:57:08.649820 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f370f-a854-4e37-b539-5436d4042957 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.677375 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dd084-dcb5-4c6f-b5a7-e514a72d8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.678172 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dd084-dcb5-4c6f-b5a7-e514a72d8624 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.678462 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dd084-dcb5-4c6f-b5a7-e514a72d8624 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.678739 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dd084-dcb5-4c6f-b5a7-e514a72d8624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.686665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dd084-dcb5-4c6f-b5a7-e514a72d8624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.688307 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dd084-dcb5-4c6f-b5a7-e514a72d8624 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-b35dd084-dcb5-4c6f-b5a7-e514a72d8624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:08.702524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:08.703703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:08.704574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:08.704574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:08.704574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:08.704574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:08.704574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:08.704574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:08.704574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:08.704574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:08.704574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 261/520] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:08.705040 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dd084-dcb5-4c6f-b5a7-e514a72d8624 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.752836 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f370f-a854-4e37-b539-5436d4042957 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.756869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:08.787875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49c26e-4586-484f-b535-662e65630a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.788666 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49c26e-4586-484f-b535-662e65630a20 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.788957 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49c26e-4586-484f-b535-662e65630a20 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.789233 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49c26e-4586-484f-b535-662e65630a20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.796541 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49c26e-4586-484f-b535-662e65630a20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.797920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49c26e-4586-484f-b535-662e65630a20 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.808940 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dd084-dcb5-4c6f-b5a7-e514a72d8624 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-ee49c26e-4586-484f-b535-662e65630a20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:08.812261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:08.813270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:08.818828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:08.818828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:08.818828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:08.818828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:08.818828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:08.818828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:08.818828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:08.818828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:08.818828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 260/521] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:08.818828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49c26e-4586-484f-b535-662e65630a20 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.848352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5253d-755c-457b-8f20-f6fa3d6cf126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.849007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5253d-755c-457b-8f20-f6fa3d6cf126 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.849292 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5253d-755c-457b-8f20-f6fa3d6cf126 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.849570 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5253d-755c-457b-8f20-f6fa3d6cf126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.850388 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5253d-755c-457b-8f20-f6fa3d6cf126 None admin] RBAC: Adding query filter params (role.id=3e9fca7423f14eb999603c531dfb03b4, scope.project.id=55faf272643648349c655751011854b8, user.id=6aa237d6badd493a9f2a75bf4086fec3) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:08.850705 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5253d-755c-457b-8f20-f6fa3d6cf126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.852864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5253d-755c-457b-8f20-f6fa3d6cf126 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:08.858406 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 262/522] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/role_assignments?user.id=6aa237d6badd493a9f2a75bf4086fec3&scope.project.id=55faf272643648349c655751011854b8&role.id=3e9fca7423f14eb999603c531dfb03b4 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:08.859211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5253d-755c-457b-8f20-f6fa3d6cf126 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:08.881656 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:08.932641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49c26e-4586-484f-b535-662e65630a20 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.972102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c85c7-0cd2-44aa-971b-e97348fa6520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:08.973035 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c85c7-0cd2-44aa-971b-e97348fa6520 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:08.973220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c85c7-0cd2-44aa-971b-e97348fa6520 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:08.973508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c85c7-0cd2-44aa-971b-e97348fa6520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:08.986445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c85c7-0cd2-44aa-971b-e97348fa6520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:08.987904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5253d-755c-457b-8f20-f6fa3d6cf126 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:08.988374 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c85c7-0cd2-44aa-971b-e97348fa6520 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:09.003253 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-a62c85c7-0cd2-44aa-971b-e97348fa6520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:09.007737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:09.008686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:09.009539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:09.009539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:09.009539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:09.009539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:09.009539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 261/523] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:09.010687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c85c7-0cd2-44aa-971b-e97348fa6520 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:09.034180 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a27171-33c6-4bb0-8d02-1b004d24a34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:09.034927 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a27171-33c6-4bb0-8d02-1b004d24a34f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:09.035221 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a27171-33c6-4bb0-8d02-1b004d24a34f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:09.035509 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a27171-33c6-4bb0-8d02-1b004d24a34f None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:09.036301 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a27171-33c6-4bb0-8d02-1b004d24a34f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:09.036618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a27171-33c6-4bb0-8d02-1b004d24a34f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:09.038170 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a27171-33c6-4bb0-8d02-1b004d24a34f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:09.052860 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 263/524] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:09.053624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a27171-33c6-4bb0-8d02-1b004d24a34f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:09.132671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c85c7-0cd2-44aa-971b-e97348fa6520 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:09.145607 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:09.169290 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a27171-33c6-4bb0-8d02-1b004d24a34f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:09.174849 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f7244-2d98-4cff-8b3d-3ecaefb525ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:09.175633 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f7244-2d98-4cff-8b3d-3ecaefb525ee None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:09.175993 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f7244-2d98-4cff-8b3d-3ecaefb525ee None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:09.176348 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f7244-2d98-4cff-8b3d-3ecaefb525ee None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:09.177334 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f7244-2d98-4cff-8b3d-3ecaefb525ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:09.177878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f7244-2d98-4cff-8b3d-3ecaefb525ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:09.179098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f7244-2d98-4cff-8b3d-3ecaefb525ee None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:09.198581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 262/525] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:09.199369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f7244-2d98-4cff-8b3d-3ecaefb525ee None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:09.211237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11f147-f4ac-4d69-84ec-8f9a0f8beb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:09.212129 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11f147-f4ac-4d69-84ec-8f9a0f8beb9f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:09.212436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11f147-f4ac-4d69-84ec-8f9a0f8beb9f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:09.212832 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11f147-f4ac-4d69-84ec-8f9a0f8beb9f None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:09.213685 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11f147-f4ac-4d69-84ec-8f9a0f8beb9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:09.214053 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11f147-f4ac-4d69-84ec-8f9a0f8beb9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:09.215458 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11f147-f4ac-4d69-84ec-8f9a0f8beb9f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:09.233334 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 264/526] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:09.233334 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11f147-f4ac-4d69-84ec-8f9a0f8beb9f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:09.267564 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:09.321418 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f7244-2d98-4cff-8b3d-3ecaefb525ee None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:09.348344 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11f147-f4ac-4d69-84ec-8f9a0f8beb9f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:09.362346 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91ee6c-29b4-4e28-b089-bff53289b3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:09.363079 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91ee6c-29b4-4e28-b089-bff53289b3e5 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:09.363474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91ee6c-29b4-4e28-b089-bff53289b3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:09.363760 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91ee6c-29b4-4e28-b089-bff53289b3e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:09.364844 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91ee6c-29b4-4e28-b089-bff53289b3e5 None admin] RBAC: Adding query filter params (role.id=3e9fca7423f14eb999603c531dfb03b4, scope.project.id=55faf272643648349c655751011854b8, user.id=1e21b5991e7345149a4d0e644a436099) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:09.365242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91ee6c-29b4-4e28-b089-bff53289b3e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:09.366690 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91ee6c-29b4-4e28-b089-bff53289b3e5 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:09.384151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 263/527] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:57:09 2022] GET /identity/v3/role_assignments?user.id=1e21b5991e7345149a4d0e644a436099&scope.project.id=55faf272643648349c655751011854b8&role.id=3e9fca7423f14eb999603c531dfb03b4 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:09.385573 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91ee6c-29b4-4e28-b089-bff53289b3e5 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:09.388002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570942f-e823-480b-8d75-dae18a143117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:09.389100 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570942f-e823-480b-8d75-dae18a143117 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:09.389566 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570942f-e823-480b-8d75-dae18a143117 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:09.390070 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570942f-e823-480b-8d75-dae18a143117 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:09.391182 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570942f-e823-480b-8d75-dae18a143117 None admin] RBAC: Adding query filter params (role.id=3e9fca7423f14eb999603c531dfb03b4, scope.project.id=55faf272643648349c655751011854b8, user.id=c000c774dc134acabf8abaa701de3be4) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:09.391742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570942f-e823-480b-8d75-dae18a143117 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:09.393470 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570942f-e823-480b-8d75-dae18a143117 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:09.401644 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 265/528] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:57:09 2022] GET /identity/v3/role_assignments?user.id=c000c774dc134acabf8abaa701de3be4&scope.project.id=55faf272643648349c655751011854b8&role.id=3e9fca7423f14eb999603c531dfb03b4 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:09.428428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:09.522022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91ee6c-29b4-4e28-b089-bff53289b3e5 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:09.566010 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a22ef-d67a-4e77-89f5-5e90d054019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:09.566833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a22ef-d67a-4e77-89f5-5e90d054019c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:09.567119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a22ef-d67a-4e77-89f5-5e90d054019c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:09.567427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a22ef-d67a-4e77-89f5-5e90d054019c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:09.576736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a22ef-d67a-4e77-89f5-5e90d054019c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:09.578188 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a22ef-d67a-4e77-89f5-5e90d054019c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-fe8a22ef-d67a-4e77-89f5-5e90d054019c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:09.594622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:09.595624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:09.596527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:09.596527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:09.596527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:09.596527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:09.596527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:09.596527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:09.596527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:09.596527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:09.596943 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 264/529] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:09.603217 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570942f-e823-480b-8d75-dae18a143117 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:09.712027 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:09.718645 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570942f-e823-480b-8d75-dae18a143117 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:09.756025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3864205-5321-46a5-ae2e-a9629349b59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:09.756698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3864205-5321-46a5-ae2e-a9629349b59f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:09.756987 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3864205-5321-46a5-ae2e-a9629349b59f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:09.757523 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3864205-5321-46a5-ae2e-a9629349b59f None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:09.759266 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3864205-5321-46a5-ae2e-a9629349b59f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:09.759586 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3864205-5321-46a5-ae2e-a9629349b59f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:09.761135 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3864205-5321-46a5-ae2e-a9629349b59f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:09.778904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 266/530] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:09.780370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a22ef-d67a-4e77-89f5-5e90d054019c None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:09.885410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:09.893659 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a22ef-d67a-4e77-89f5-5e90d054019c None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:09.931960 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08575f76-de1d-435c-9369-815cbfddbb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:09.932975 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575f76-de1d-435c-9369-815cbfddbb6e None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:09.933464 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575f76-de1d-435c-9369-815cbfddbb6e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:09.933940 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575f76-de1d-435c-9369-815cbfddbb6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:09.934997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08575f76-de1d-435c-9369-815cbfddbb6e None admin] RBAC: Adding query filter params (role.id=3e9fca7423f14eb999603c531dfb03b4, scope.project.id=55faf272643648349c655751011854b8, user.id=b04784c6c0684d8082b954cd4caf32bf) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:09.935545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08575f76-de1d-435c-9369-815cbfddbb6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:09.937252 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08575f76-de1d-435c-9369-815cbfddbb6e None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:09.943907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 265/531] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:57:09 2022] GET /identity/v3/role_assignments?user.id=b04784c6c0684d8082b954cd4caf32bf&scope.project.id=55faf272643648349c655751011854b8&role.id=3e9fca7423f14eb999603c531dfb03b4 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:11.212440 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757596b-191a-4a53-a617-785d8a6eb116 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:11.213595 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757596b-191a-4a53-a617-785d8a6eb116 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:11.214108 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757596b-191a-4a53-a617-785d8a6eb116 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:11.216055 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 267/532] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:11.221579 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46027ab5-35ee-41db-a93a-6b31808416e4 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:11.222438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46027ab5-35ee-41db-a93a-6b31808416e4 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:11.222939 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46027ab5-35ee-41db-a93a-6b31808416e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:11.242320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-46027ab5-35ee-41db-a93a-6b31808416e4 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:11.243959 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-46027ab5-35ee-41db-a93a-6b31808416e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:11.329206 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 266/533] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:11.353652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757596b-191a-4a53-a617-785d8a6eb116 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:11.476508 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757596b-191a-4a53-a617-785d8a6eb116 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:11.514293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc6657-6af5-4448-94eb-7b3471e5a95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:11.515156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc6657-6af5-4448-94eb-7b3471e5a95f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:11.515447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc6657-6af5-4448-94eb-7b3471e5a95f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:11.515725 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc6657-6af5-4448-94eb-7b3471e5a95f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:11.527156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc6657-6af5-4448-94eb-7b3471e5a95f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-29bc6657-6af5-4448-94eb-7b3471e5a95f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:11.535016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:11.536002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:11.536833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 268/534] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:11.543860 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46027ab5-35ee-41db-a93a-6b31808416e4 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:11.639026 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:11.658772 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46027ab5-35ee-41db-a93a-6b31808416e4 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:11.701614 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682871b-f471-436b-afcc-72d93ad09c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:11.702319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682871b-f471-436b-afcc-72d93ad09c61 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:11.702627 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682871b-f471-436b-afcc-72d93ad09c61 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:11.703022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682871b-f471-436b-afcc-72d93ad09c61 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:11.703839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682871b-f471-436b-afcc-72d93ad09c61 None admin] RBAC: Adding query filter params (name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:11.704185 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682871b-f471-436b-afcc-72d93ad09c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:11.705650 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682871b-f471-436b-afcc-72d93ad09c61 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:11.714922 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 267/535] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:11.720588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc6657-6af5-4448-94eb-7b3471e5a95f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:11.741014 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:11.790872 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188ad5a-7a50-44e8-b12f-46c628072bd7 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:11.791226 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188ad5a-7a50-44e8-b12f-46c628072bd7 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:11.791471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188ad5a-7a50-44e8-b12f-46c628072bd7 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:11.793072 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 268/536] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:11.798101 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda895-4fb7-4f24-b940-44ae9edb92a3 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:11.798392 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda895-4fb7-4f24-b940-44ae9edb92a3 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:11.798672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda895-4fb7-4f24-b940-44ae9edb92a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:11.820351 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-e5bda895-4fb7-4f24-b940-44ae9edb92a3 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:11.822761 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-e5bda895-4fb7-4f24-b940-44ae9edb92a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:11.841748 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc6657-6af5-4448-94eb-7b3471e5a95f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:11.878686 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d8898-5514-419a-93ec-da593ea86c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:11.879523 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8898-5514-419a-93ec-da593ea86c42 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:11.879805 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8898-5514-419a-93ec-da593ea86c42 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:11.880077 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8898-5514-419a-93ec-da593ea86c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:11.891765 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d8898-5514-419a-93ec-da593ea86c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:11.893234 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d8898-5514-419a-93ec-da593ea86c42 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:11.903314 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 269/537] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:57:11.904957 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951bec0-4255-4f17-8d7c-a83cf4af4d30 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:11.905478 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951bec0-4255-4f17-8d7c-a83cf4af4d30 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:11.905931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951bec0-4255-4f17-8d7c-a83cf4af4d30 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-8c4d8898-5514-419a-93ec-da593ea86c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:11.911973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:11.912815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:11.913641 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:11.913641 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:11.913641 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:11.913641 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:11.913641 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 269/538] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:11.914351 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd9de-eab2-4f65-9557-029d54519c04 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:11.915005 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 270/539] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:11.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd9de-eab2-4f65-9557-029d54519c04 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:11.916146 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd9de-eab2-4f65-9557-029d54519c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:11.919487 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951bec0-4255-4f17-8d7c-a83cf4af4d30 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:11.935487 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-bd9bd9de-eab2-4f65-9557-029d54519c04 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:11.936632 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-bd9bd9de-eab2-4f65-9557-029d54519c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:12.001855 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:12.010024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 270/540] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:12.010887 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bd9de-eab2-4f65-9557-029d54519c04 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.040693 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:12.065211 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951bec0-4255-4f17-8d7c-a83cf4af4d30 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.102197 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf619f-0a8b-4108-a547-50c38509ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.102866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf619f-0a8b-4108-a547-50c38509ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.103179 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf619f-0a8b-4108-a547-50c38509ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.103463 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf619f-0a8b-4108-a547-50c38509ccb5 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.104194 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf619f-0a8b-4108-a547-50c38509ccb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:12.104504 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf619f-0a8b-4108-a547-50c38509ccb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:12.105901 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf619f-0a8b-4108-a547-50c38509ccb5 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:12.118427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 271/541] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:12.119342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf619f-0a8b-4108-a547-50c38509ccb5 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.128007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bd9de-eab2-4f65-9557-029d54519c04 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.171265 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5701-126a-4650-a67b-2c5bb300c650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.172076 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5701-126a-4650-a67b-2c5bb300c650 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.172362 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5701-126a-4650-a67b-2c5bb300c650 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.172644 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5701-126a-4650-a67b-2c5bb300c650 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.184550 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d5701-126a-4650-a67b-2c5bb300c650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-488d5701-126a-4650-a67b-2c5bb300c650 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:12.192272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:12.193150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:12.193924 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:12.198935 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 271/542] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:12.199836 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5701-126a-4650-a67b-2c5bb300c650 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.235419 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf619f-0a8b-4108-a547-50c38509ccb5 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.263029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:12.274596 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1f84c-25bc-461e-9db7-b66fa30e4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.275530 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f84c-25bc-461e-9db7-b66fa30e4f0a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.275817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f84c-25bc-461e-9db7-b66fa30e4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.276092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f84c-25bc-461e-9db7-b66fa30e4f0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.284185 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:12.290843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1f84c-25bc-461e-9db7-b66fa30e4f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-aad1f84c-25bc-461e-9db7-b66fa30e4f0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:12.299474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:12.300416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:12.301193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 272/543] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:12.301854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1f84c-25bc-461e-9db7-b66fa30e4f0a None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.316007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5701-126a-4650-a67b-2c5bb300c650 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.350776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bca0f-bab4-4324-b72f-ff6c1477c296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.351600 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bca0f-bab4-4324-b72f-ff6c1477c296 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.352520 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bca0f-bab4-4324-b72f-ff6c1477c296 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.352905 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bca0f-bab4-4324-b72f-ff6c1477c296 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.361080 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bca0f-bab4-4324-b72f-ff6c1477c296 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:12.362533 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bca0f-bab4-4324-b72f-ff6c1477c296 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-3b4bca0f-bab4-4324-b72f-ff6c1477c296 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:12.377115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:12.378250 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:12.379343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 272/544] 10.222.0.98 () {56 vars in 1093 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:12.380058 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bcab1-a525-4e8c-be6c-ac3a2e0879f1 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.380058 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bcab1-a525-4e8c-be6c-ac3a2e0879f1 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.380213 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bcab1-a525-4e8c-be6c-ac3a2e0879f1 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.381543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 273/545] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:12.384005 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bcab1-a525-4e8c-be6c-ac3a2e0879f1 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.404452 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1f84c-25bc-461e-9db7-b66fa30e4f0a None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.438698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902d880-0328-4a07-9842-6766ea91feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.439389 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902d880-0328-4a07-9842-6766ea91feca None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.439684 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902d880-0328-4a07-9842-6766ea91feca None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.439979 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902d880-0328-4a07-9842-6766ea91feca None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.440704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902d880-0328-4a07-9842-6766ea91feca None admin] RBAC: Adding query filter params (name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:12.441013 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902d880-0328-4a07-9842-6766ea91feca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:12.442397 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902d880-0328-4a07-9842-6766ea91feca None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:12.450514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 273/546] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:12.451329 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902d880-0328-4a07-9842-6766ea91feca None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.492314 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bcab1-a525-4e8c-be6c-ac3a2e0879f1 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.509419 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:12.513598 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:12.527004 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158371f-52b9-419b-9e49-a8bb2904ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.527705 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158371f-52b9-419b-9e49-a8bb2904ce04 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.527995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158371f-52b9-419b-9e49-a8bb2904ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.528276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158371f-52b9-419b-9e49-a8bb2904ce04 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.529024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158371f-52b9-419b-9e49-a8bb2904ce04 None admin] RBAC: Adding query filter params (name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:12.529334 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158371f-52b9-419b-9e49-a8bb2904ce04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:12.530730 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158371f-52b9-419b-9e49-a8bb2904ce04 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:12.538827 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 274/547] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:12.540701 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193fe76-1176-4228-b5b2-16ea478b75fd None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.540999 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193fe76-1176-4228-b5b2-16ea478b75fd None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.541279 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193fe76-1176-4228-b5b2-16ea478b75fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.554233 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902d880-0328-4a07-9842-6766ea91feca None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.558503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-3193fe76-1176-4228-b5b2-16ea478b75fd None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:12.559831 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-3193fe76-1176-4228-b5b2-16ea478b75fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:12.588241 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf64a7-0039-4c22-afaf-cd4061e2daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.588907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf64a7-0039-4c22-afaf-cd4061e2daeb None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.589193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf64a7-0039-4c22-afaf-cd4061e2daeb None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.589476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf64a7-0039-4c22-afaf-cd4061e2daeb None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.590312 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf64a7-0039-4c22-afaf-cd4061e2daeb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:12.590625 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf64a7-0039-4c22-afaf-cd4061e2daeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:12.592094 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf64a7-0039-4c22-afaf-cd4061e2daeb None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:12.609460 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 274/548] 10.222.0.98 () {56 vars in 1133 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:12.610336 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf64a7-0039-4c22-afaf-cd4061e2daeb None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.630939 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 275/549] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:12.631805 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193fe76-1176-4228-b5b2-16ea478b75fd None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.716259 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf64a7-0039-4c22-afaf-cd4061e2daeb None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.735765 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193fe76-1176-4228-b5b2-16ea478b75fd None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.736635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:12.747452 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:12.753642 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ed29f-4bbc-4f16-b7d7-b7ff53b1cdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.754434 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ed29f-4bbc-4f16-b7d7-b7ff53b1cdcb None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.754720 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ed29f-4bbc-4f16-b7d7-b7ff53b1cdcb None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.754998 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ed29f-4bbc-4f16-b7d7-b7ff53b1cdcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.766114 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ed29f-4bbc-4f16-b7d7-b7ff53b1cdcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:12.767471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ed29f-4bbc-4f16-b7d7-b7ff53b1cdcb None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:12.773021 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669f773-19f5-499a-a003-c5ea02870ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.773821 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669f773-19f5-499a-a003-c5ea02870ace None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.774102 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669f773-19f5-499a-a003-c5ea02870ace None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.774382 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669f773-19f5-499a-a003-c5ea02870ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.784362 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669f773-19f5-499a-a003-c5ea02870ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-247ed29f-4bbc-4f16-b7d7-b7ff53b1cdcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:12.785483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:12.786442 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:12.787378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:12.787378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:12.787378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:12.787378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:12.787599 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669f773-19f5-499a-a003-c5ea02870ace None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:12.787688 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 275/550] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:12.787688 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ed29f-4bbc-4f16-b7d7-b7ff53b1cdcb None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-1669f773-19f5-499a-a003-c5ea02870ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:12.804979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:12.806540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:12.807440 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:12.807440 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:12.807440 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:12.807440 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:12.811956 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 276/551] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:12.812769 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669f773-19f5-499a-a003-c5ea02870ace None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.889535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ed29f-4bbc-4f16-b7d7-b7ff53b1cdcb None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.917371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669f773-19f5-499a-a003-c5ea02870ace None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:12.923632 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeb8d6-f284-48f9-9300-d2a6185267e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.924423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeb8d6-f284-48f9-9300-d2a6185267e9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.924719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeb8d6-f284-48f9-9300-d2a6185267e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.924998 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeb8d6-f284-48f9-9300-d2a6185267e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.937041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeb8d6-f284-48f9-9300-d2a6185267e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:12.938503 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeb8d6-f284-48f9-9300-d2a6185267e9 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:12.951607 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe631243-a950-4fe5-81d4-060abc27a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:12.952402 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe631243-a950-4fe5-81d4-060abc27a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:12.952691 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe631243-a950-4fe5-81d4-060abc27a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:12.952972 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe631243-a950-4fe5-81d4-060abc27a3e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-0daeb8d6-f284-48f9-9300-d2a6185267e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:12.955406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:12.956441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:12.957298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:12.957298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:12.957298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:12.957298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:12.957298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 276/552] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:12.957580 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeb8d6-f284-48f9-9300-d2a6185267e9 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.969238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe631243-a950-4fe5-81d4-060abc27a3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-fe631243-a950-4fe5-81d4-060abc27a3e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:12.977606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:12.978711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 277/553] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:12.980296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe631243-a950-4fe5-81d4-060abc27a3e4 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:12.989440 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:13.006479 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:13.068257 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeb8d6-f284-48f9-9300-d2a6185267e9 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.084350 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe631243-a950-4fe5-81d4-060abc27a3e4 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.100579 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba816c-5078-4d13-824d-ebf0bc95e935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.101234 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba816c-5078-4d13-824d-ebf0bc95e935 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.101517 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba816c-5078-4d13-824d-ebf0bc95e935 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.102349 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba816c-5078-4d13-824d-ebf0bc95e935 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.103079 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba816c-5078-4d13-824d-ebf0bc95e935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:13.103394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba816c-5078-4d13-824d-ebf0bc95e935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.104756 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba816c-5078-4d13-824d-ebf0bc95e935 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.116212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 277/554] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:13.118039 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba816c-5078-4d13-824d-ebf0bc95e935 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.118544 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179d0d1-274c-49d0-8a7f-130aebd9b16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.119361 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179d0d1-274c-49d0-8a7f-130aebd9b16a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.119747 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179d0d1-274c-49d0-8a7f-130aebd9b16a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.120125 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179d0d1-274c-49d0-8a7f-130aebd9b16a None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.120952 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179d0d1-274c-49d0-8a7f-130aebd9b16a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:13.121580 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179d0d1-274c-49d0-8a7f-130aebd9b16a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.123003 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179d0d1-274c-49d0-8a7f-130aebd9b16a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.135334 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 278/555] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:13.136015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179d0d1-274c-49d0-8a7f-130aebd9b16a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.204930 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:13.218064 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:13.222061 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba816c-5078-4d13-824d-ebf0bc95e935 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.236929 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179d0d1-274c-49d0-8a7f-130aebd9b16a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.256553 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e5933-e106-4bc8-aaa7-5056930a3e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.257462 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5933-e106-4bc8-aaa7-5056930a3e16 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.257745 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5933-e106-4bc8-aaa7-5056930a3e16 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.258058 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5933-e106-4bc8-aaa7-5056930a3e16 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.258844 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e5933-e106-4bc8-aaa7-5056930a3e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:13.259101 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e5933-e106-4bc8-aaa7-5056930a3e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.260557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e5933-e106-4bc8-aaa7-5056930a3e16 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.271963 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 278/556] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:13.272703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e5933-e106-4bc8-aaa7-5056930a3e16 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.273079 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6e44d-0713-40ab-aaee-19024e325785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.274947 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6e44d-0713-40ab-aaee-19024e325785 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.275209 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6e44d-0713-40ab-aaee-19024e325785 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.275487 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6e44d-0713-40ab-aaee-19024e325785 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.276235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6e44d-0713-40ab-aaee-19024e325785 None admin] RBAC: Adding query filter params (name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:13.276542 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6e44d-0713-40ab-aaee-19024e325785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.278190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6e44d-0713-40ab-aaee-19024e325785 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.286406 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 279/557] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:13.287212 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6e44d-0713-40ab-aaee-19024e325785 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.379627 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e5933-e106-4bc8-aaa7-5056930a3e16 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.396669 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6e44d-0713-40ab-aaee-19024e325785 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.413249 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4627273-8a3e-4f21-a915-14efddaba31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.414046 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4627273-8a3e-4f21-a915-14efddaba31f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.415043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4627273-8a3e-4f21-a915-14efddaba31f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.415496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4627273-8a3e-4f21-a915-14efddaba31f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.423095 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4627273-8a3e-4f21-a915-14efddaba31f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.424563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4627273-8a3e-4f21-a915-14efddaba31f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.431969 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed124ed6-8434-46b6-b1d9-b94091d2e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.432795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed124ed6-8434-46b6-b1d9-b94091d2e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.433085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed124ed6-8434-46b6-b1d9-b94091d2e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.433365 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed124ed6-8434-46b6-b1d9-b94091d2e6e2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-a4627273-8a3e-4f21-a915-14efddaba31f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:13.438689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:13.439698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 279/558] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:13.445763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4627273-8a3e-4f21-a915-14efddaba31f None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.446624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed124ed6-8434-46b6-b1d9-b94091d2e6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.446624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed124ed6-8434-46b6-b1d9-b94091d2e6e2 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.448397 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-ed124ed6-8434-46b6-b1d9-b94091d2e6e2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:13.457436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:13.464625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 280/559] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed124ed6-8434-46b6-b1d9-b94091d2e6e2 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.466051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:13.555667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4627273-8a3e-4f21-a915-14efddaba31f None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.565466 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed124ed6-8434-46b6-b1d9-b94091d2e6e2 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.590584 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b7ab6-1512-4608-9a63-c6a41bdc02bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.591403 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b7ab6-1512-4608-9a63-c6a41bdc02bd None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.591716 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b7ab6-1512-4608-9a63-c6a41bdc02bd None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.592003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b7ab6-1512-4608-9a63-c6a41bdc02bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.598744 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b7ab6-1512-4608-9a63-c6a41bdc02bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.599419 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613b3c-b446-4459-9505-b602fe37de08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.600220 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613b3c-b446-4459-9505-b602fe37de08 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.600325 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b7ab6-1512-4608-9a63-c6a41bdc02bd None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.600507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613b3c-b446-4459-9505-b602fe37de08 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.600789 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613b3c-b446-4459-9505-b602fe37de08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.611512 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af613b3c-b446-4459-9505-b602fe37de08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.612951 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af613b3c-b446-4459-9505-b602fe37de08 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-a92b7ab6-1512-4608-9a63-c6a41bdc02bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:13.614327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:13.615208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:13.621385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:13.621385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:13.621385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:13.621385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:13.621385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:13.621385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:13.621385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:13.621385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:13.621385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 280/560] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:13.621385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b7ab6-1512-4608-9a63-c6a41bdc02bd None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-af613b3c-b446-4459-9505-b602fe37de08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:13.630693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:13.631718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:13.632857 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:13.632857 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:13.632857 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:13.632857 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:13.632857 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 281/561] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:13.633767 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613b3c-b446-4459-9505-b602fe37de08 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.685688 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:13.690801 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:13.727502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b7ab6-1512-4608-9a63-c6a41bdc02bd None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.736377 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613b3c-b446-4459-9505-b602fe37de08 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.762307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce47ddb-b667-4418-865e-ae710cbf2643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.762977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47ddb-b667-4418-865e-ae710cbf2643 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.763294 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47ddb-b667-4418-865e-ae710cbf2643 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.763572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47ddb-b667-4418-865e-ae710cbf2643 None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.764415 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce47ddb-b667-4418-865e-ae710cbf2643 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:13.764727 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce47ddb-b667-4418-865e-ae710cbf2643 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.766182 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce47ddb-b667-4418-865e-ae710cbf2643 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.771394 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128b173-f1ba-4414-a989-ae01e572ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.772059 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128b173-f1ba-4414-a989-ae01e572ec87 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.772345 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128b173-f1ba-4414-a989-ae01e572ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.772622 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128b173-f1ba-4414-a989-ae01e572ec87 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.773450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128b173-f1ba-4414-a989-ae01e572ec87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:13.773796 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128b173-f1ba-4414-a989-ae01e572ec87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.775428 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128b173-f1ba-4414-a989-ae01e572ec87 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.783355 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 281/562] 10.222.0.98 () {56 vars in 1137 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:13.784172 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce47ddb-b667-4418-865e-ae710cbf2643 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.794029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 282/563] 10.222.0.98 () {56 vars in 1137 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:13.794852 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128b173-f1ba-4414-a989-ae01e572ec87 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.885744 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce47ddb-b667-4418-865e-ae710cbf2643 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.893043 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128b173-f1ba-4414-a989-ae01e572ec87 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:13.906681 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:13.907691 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:13.920178 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cb911-d62d-4875-9234-7206c26aaaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.920837 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cb911-d62d-4875-9234-7206c26aaaea None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.921126 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cb911-d62d-4875-9234-7206c26aaaea None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.921406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cb911-d62d-4875-9234-7206c26aaaea None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.922195 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cb911-d62d-4875-9234-7206c26aaaea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:13.922606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cb911-d62d-4875-9234-7206c26aaaea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.923986 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cb911-d62d-4875-9234-7206c26aaaea None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.927885 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc4cd4-a1ab-46fb-bb3e-de93c20f2b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:13.928544 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc4cd4-a1ab-46fb-bb3e-de93c20f2b0e None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:13.928830 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc4cd4-a1ab-46fb-bb3e-de93c20f2b0e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:13.929110 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc4cd4-a1ab-46fb-bb3e-de93c20f2b0e None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:13.930568 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc4cd4-a1ab-46fb-bb3e-de93c20f2b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:13.930568 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc4cd4-a1ab-46fb-bb3e-de93c20f2b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:13.932346 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc4cd4-a1ab-46fb-bb3e-de93c20f2b0e None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:13.936658 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 282/564] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:13.937462 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cb911-d62d-4875-9234-7206c26aaaea None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:13.947015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 283/565] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:13.947015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc4cd4-a1ab-46fb-bb3e-de93c20f2b0e None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.042650 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cb911-d62d-4875-9234-7206c26aaaea None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.045383 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc4cd4-a1ab-46fb-bb3e-de93c20f2b0e None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.076845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d4f8d-5d57-4776-8959-20fa1a27eff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:14.077880 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d4f8d-5d57-4776-8959-20fa1a27eff4 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:14.078166 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d4f8d-5d57-4776-8959-20fa1a27eff4 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:14.078443 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d4f8d-5d57-4776-8959-20fa1a27eff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:14.079259 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32a8cc-0f08-4dec-93e9-618ceca77478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:14.080044 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32a8cc-0f08-4dec-93e9-618ceca77478 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:14.080329 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32a8cc-0f08-4dec-93e9-618ceca77478 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:14.080599 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32a8cc-0f08-4dec-93e9-618ceca77478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:14.088867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d4f8d-5d57-4776-8959-20fa1a27eff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:14.090311 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d4f8d-5d57-4776-8959-20fa1a27eff4 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:14.091244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32a8cc-0f08-4dec-93e9-618ceca77478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:14.092678 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32a8cc-0f08-4dec-93e9-618ceca77478 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-238d4f8d-5d57-4776-8959-20fa1a27eff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:14.107492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:14.108427 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:14.109316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:14.109316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:14.109316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:14.109316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:14.109316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 283/566] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:14.109586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d4f8d-5d57-4776-8959-20fa1a27eff4 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-ce32a8cc-0f08-4dec-93e9-618ceca77478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:14.109661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:14.110517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:14.111463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:14.111463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:14.111463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:14.111463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:14.111463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 284/567] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:14.111463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32a8cc-0f08-4dec-93e9-618ceca77478 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.141647 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:14.148014 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:14.214170 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d4f8d-5d57-4776-8959-20fa1a27eff4 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.214363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32a8cc-0f08-4dec-93e9-618ceca77478 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.247835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe0733-520b-402f-b4a3-717e30421ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:14.248024 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e7471-ba50-4696-b491-ea0b15f8e85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:14.248630 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0733-520b-402f-b4a3-717e30421ddb None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:14.248746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7471-ba50-4696-b491-ea0b15f8e85d None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:14.248916 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0733-520b-402f-b4a3-717e30421ddb None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:14.249019 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7471-ba50-4696-b491-ea0b15f8e85d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:14.249191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0733-520b-402f-b4a3-717e30421ddb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:14.249292 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7471-ba50-4696-b491-ea0b15f8e85d None admin] PATH_INFO: `/v3/projects/55faf272643648349c655751011854b8/users/6aa237d6badd493a9f2a75bf4086fec3/roles/3e9fca7423f14eb999603c531dfb03b4` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:14.256610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe0733-520b-402f-b4a3-717e30421ddb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:14.258870 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe0733-520b-402f-b4a3-717e30421ddb None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:14.264967 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e7471-ba50-4696-b491-ea0b15f8e85d None admin] RBAC: Authorizing `identity:create_grant(project_id=55faf272643648349c655751011854b8, user_id=6aa237d6badd493a9f2a75bf4086fec3, role_id=3e9fca7423f14eb999603c531dfb03b4)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:14.266479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e7471-ba50-4696-b491-ea0b15f8e85d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-fbbe0733-520b-402f-b4a3-717e30421ddb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:14.273283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:14.275025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 285/568] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:14.276083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe0733-520b-402f-b4a3-717e30421ddb None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.283833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 284/569] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:57:14 2022] PUT /identity/v3/projects/55faf272643648349c655751011854b8/users/6aa237d6badd493a9f2a75bf4086fec3/roles/3e9fca7423f14eb999603c531dfb03b4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:57:14.284641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e7471-ba50-4696-b491-ea0b15f8e85d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.384644 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:14.402094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe0733-520b-402f-b4a3-717e30421ddb None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.403155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:14.424454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e7471-ba50-4696-b491-ea0b15f8e85d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.443466 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e774b4-5120-4803-ba54-0587319fdb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:14.444146 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e774b4-5120-4803-ba54-0587319fdb77 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:14.444433 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e774b4-5120-4803-ba54-0587319fdb77 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:14.444712 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e774b4-5120-4803-ba54-0587319fdb77 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:14.445451 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e774b4-5120-4803-ba54-0587319fdb77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:14.445879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e774b4-5120-4803-ba54-0587319fdb77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:14.447333 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e774b4-5120-4803-ba54-0587319fdb77 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:14.463568 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 286/570] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:14.463568 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e774b4-5120-4803-ba54-0587319fdb77 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.469702 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca5b26-b1ee-479c-b4d3-24a158054a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:14.470376 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca5b26-b1ee-479c-b4d3-24a158054a1d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:14.470663 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca5b26-b1ee-479c-b4d3-24a158054a1d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:14.470940 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca5b26-b1ee-479c-b4d3-24a158054a1d None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:14.471863 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca5b26-b1ee-479c-b4d3-24a158054a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:14.472226 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca5b26-b1ee-479c-b4d3-24a158054a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:14.473582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca5b26-b1ee-479c-b4d3-24a158054a1d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:14.486694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 285/571] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:14.487459 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca5b26-b1ee-479c-b4d3-24a158054a1d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.575518 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e774b4-5120-4803-ba54-0587319fdb77 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.595631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca5b26-b1ee-479c-b4d3-24a158054a1d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.611962 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e596db2-f1bf-455a-98cc-ff86a5ad159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:14.612929 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596db2-f1bf-455a-98cc-ff86a5ad159b None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:14.613403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596db2-f1bf-455a-98cc-ff86a5ad159b None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:14.613676 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596db2-f1bf-455a-98cc-ff86a5ad159b None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:14.614563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e596db2-f1bf-455a-98cc-ff86a5ad159b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:14.614902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e596db2-f1bf-455a-98cc-ff86a5ad159b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:14.616391 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e596db2-f1bf-455a-98cc-ff86a5ad159b None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:14.632325 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96e40f-7c43-431a-94d0-f565b8aa070b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:14.633330 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96e40f-7c43-431a-94d0-f565b8aa070b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:14.633687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96e40f-7c43-431a-94d0-f565b8aa070b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:14.633981 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96e40f-7c43-431a-94d0-f565b8aa070b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:14.634826 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 287/572] 10.222.0.98 () {56 vars in 1139 bytes} [Mon Jul 25 18:57:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:14.640235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e596db2-f1bf-455a-98cc-ff86a5ad159b None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.641664 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96e40f-7c43-431a-94d0-f565b8aa070b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:14.643121 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96e40f-7c43-431a-94d0-f565b8aa070b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:14.643969 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-5d96e40f-7c43-431a-94d0-f565b8aa070b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:14.658965 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:14.659935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:14.660859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:14.660859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:14.660859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:14.660859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:14.660859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:14.660859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:14.660859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:14.660859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:14.660859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 286/573] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:14.661966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96e40f-7c43-431a-94d0-f565b8aa070b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.665586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:14.757720 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e596db2-f1bf-455a-98cc-ff86a5ad159b None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.777979 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96e40f-7c43-431a-94d0-f565b8aa070b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.802461 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1998f-ad41-405e-8670-0b33c306c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:14.803608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1998f-ad41-405e-8670-0b33c306c923 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:14.804106 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1998f-ad41-405e-8670-0b33c306c923 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:14.804738 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1998f-ad41-405e-8670-0b33c306c923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:14.812610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1998f-ad41-405e-8670-0b33c306c923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:14.814320 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1998f-ad41-405e-8670-0b33c306c923 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:14.818902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42ae2-9bd6-47ef-bc0a-8419cb47e287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:14.819741 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42ae2-9bd6-47ef-bc0a-8419cb47e287 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:14.820187 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42ae2-9bd6-47ef-bc0a-8419cb47e287 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:14.820551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42ae2-9bd6-47ef-bc0a-8419cb47e287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-7cd1998f-ad41-405e-8670-0b33c306c923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:14.828746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:14.829624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:14.830504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:14.830504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:14.830504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:14.830504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:14.830504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:14.830504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:14.830504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:14.830504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:14.830504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 288/574] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:14.830987 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1998f-ad41-405e-8670-0b33c306c923 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.837310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae42ae2-9bd6-47ef-bc0a-8419cb47e287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:14.838859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae42ae2-9bd6-47ef-bc0a-8419cb47e287 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-fae42ae2-9bd6-47ef-bc0a-8419cb47e287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:14.860391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:14.861521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:14.862628 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:14.862628 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:14.862628 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:14.862628 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:14.867795 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 287/575] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:14.867795 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42ae2-9bd6-47ef-bc0a-8419cb47e287 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:14.919171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:14.924707 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:14.965347 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1998f-ad41-405e-8670-0b33c306c923 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:14.976566 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42ae2-9bd6-47ef-bc0a-8419cb47e287 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:15.000994 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d67a9-a497-4073-9d56-6617fa771d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:15.001661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d67a9-a497-4073-9d56-6617fa771d57 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:15.001936 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d67a9-a497-4073-9d56-6617fa771d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:15.002216 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d67a9-a497-4073-9d56-6617fa771d57 None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:15.003005 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d67a9-a497-4073-9d56-6617fa771d57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:15.003349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d67a9-a497-4073-9d56-6617fa771d57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:15.004807 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d67a9-a497-4073-9d56-6617fa771d57 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:15.016300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcdc98-b6a8-4e5b-8347-05590258e01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:15.016968 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcdc98-b6a8-4e5b-8347-05590258e01a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:15.017262 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcdc98-b6a8-4e5b-8347-05590258e01a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:15.017540 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcdc98-b6a8-4e5b-8347-05590258e01a None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:15.018329 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcdc98-b6a8-4e5b-8347-05590258e01a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:15.018643 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcdc98-b6a8-4e5b-8347-05590258e01a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:15.025082 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcdc98-b6a8-4e5b-8347-05590258e01a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:15.025232 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 289/576] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:15.025232 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d67a9-a497-4073-9d56-6617fa771d57 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:15.036831 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 288/577] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:15.037515 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcdc98-b6a8-4e5b-8347-05590258e01a None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:15.131090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d67a9-a497-4073-9d56-6617fa771d57 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:15.151835 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcdc98-b6a8-4e5b-8347-05590258e01a None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:15.161702 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:15.169898 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:15.173891 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71cec2-32d7-4bf5-8ea2-8894d4462847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:15.174554 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71cec2-32d7-4bf5-8ea2-8894d4462847 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:15.174841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71cec2-32d7-4bf5-8ea2-8894d4462847 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:15.175118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71cec2-32d7-4bf5-8ea2-8894d4462847 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:15.175863 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71cec2-32d7-4bf5-8ea2-8894d4462847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:15.176176 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71cec2-32d7-4bf5-8ea2-8894d4462847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:15.177555 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71cec2-32d7-4bf5-8ea2-8894d4462847 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:15.188965 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 290/578] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:15.189731 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71cec2-32d7-4bf5-8ea2-8894d4462847 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:15.195034 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e35b7-1c77-48d0-acc1-16543b944f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:15.196822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e35b7-1c77-48d0-acc1-16543b944f91 None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:15.197112 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e35b7-1c77-48d0-acc1-16543b944f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:15.197393 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e35b7-1c77-48d0-acc1-16543b944f91 None admin] PATH_INFO: `/v3/projects/55faf272643648349c655751011854b8/users/c000c774dc134acabf8abaa701de3be4/roles/3e9fca7423f14eb999603c531dfb03b4` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:15.215549 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e35b7-1c77-48d0-acc1-16543b944f91 None admin] RBAC: Authorizing `identity:create_grant(project_id=55faf272643648349c655751011854b8, user_id=c000c774dc134acabf8abaa701de3be4, role_id=3e9fca7423f14eb999603c531dfb03b4)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:15.216998 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e35b7-1c77-48d0-acc1-16543b944f91 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:15.230358 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 289/579] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:57:15 2022] PUT /identity/v3/projects/55faf272643648349c655751011854b8/users/c000c774dc134acabf8abaa701de3be4/roles/3e9fca7423f14eb999603c531dfb03b4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:57:15.231086 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e35b7-1c77-48d0-acc1-16543b944f91 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:15.353025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71cec2-32d7-4bf5-8ea2-8894d4462847 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:15.374614 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e35b7-1c77-48d0-acc1-16543b944f91 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:15.402152 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0a11f-8fe0-4766-a811-c7cd00901852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:15.403375 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0a11f-8fe0-4766-a811-c7cd00901852 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:15.404120 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0a11f-8fe0-4766-a811-c7cd00901852 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:15.404406 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0a11f-8fe0-4766-a811-c7cd00901852 None admin] PATH_INFO: `/v3/projects/55faf272643648349c655751011854b8/users/1e21b5991e7345149a4d0e644a436099/roles/3e9fca7423f14eb999603c531dfb03b4` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:15.415543 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3cf13-42ce-4660-b798-7b4e99c1299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:15.416357 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3cf13-42ce-4660-b798-7b4e99c1299c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:15.416641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3cf13-42ce-4660-b798-7b4e99c1299c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:15.416913 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3cf13-42ce-4660-b798-7b4e99c1299c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:15.424706 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3cf13-42ce-4660-b798-7b4e99c1299c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:15.424863 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0a11f-8fe0-4766-a811-c7cd00901852 None admin] RBAC: Authorizing `identity:create_grant(project_id=55faf272643648349c655751011854b8, user_id=1e21b5991e7345149a4d0e644a436099, role_id=3e9fca7423f14eb999603c531dfb03b4)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:15.426084 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3cf13-42ce-4660-b798-7b4e99c1299c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:15.426279 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0a11f-8fe0-4766-a811-c7cd00901852 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-39a3cf13-42ce-4660-b798-7b4e99c1299c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:15.444672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:15.445840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:15.446882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:15.446882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:15.446882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:15.446882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:15.446882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:15.446882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:15.446882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:15.446882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:15.446882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 290/581] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:15.448196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 291/581] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:57:15 2022] PUT /identity/v3/projects/55faf272643648349c655751011854b8/users/1e21b5991e7345149a4d0e644a436099/roles/3e9fca7423f14eb999603c531dfb03b4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:57:15.452425 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3cf13-42ce-4660-b798-7b4e99c1299c None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:15.490819 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:15.593181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3cf13-42ce-4660-b798-7b4e99c1299c None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:15.632824 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff89df-3f5e-4c19-a65f-e83de7f48a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:15.634500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff89df-3f5e-4c19-a65f-e83de7f48a7b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:15.634969 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff89df-3f5e-4c19-a65f-e83de7f48a7b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:15.635488 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff89df-3f5e-4c19-a65f-e83de7f48a7b None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:15.636465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff89df-3f5e-4c19-a65f-e83de7f48a7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:15.636958 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff89df-3f5e-4c19-a65f-e83de7f48a7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:15.638604 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff89df-3f5e-4c19-a65f-e83de7f48a7b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:15.652647 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 291/582] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:15.658720 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0a11f-8fe0-4766-a811-c7cd00901852 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:15.705376 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:15.782863 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0a11f-8fe0-4766-a811-c7cd00901852 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:15.820329 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ab01a-153c-4922-8340-45f061844911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:15.821444 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ab01a-153c-4922-8340-45f061844911 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:15.821737 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ab01a-153c-4922-8340-45f061844911 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:15.822016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ab01a-153c-4922-8340-45f061844911 None admin] PATH_INFO: `/v3/projects/55faf272643648349c655751011854b8/users/b04784c6c0684d8082b954cd4caf32bf/roles/3e9fca7423f14eb999603c531dfb03b4` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:15.837318 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ab01a-153c-4922-8340-45f061844911 None admin] RBAC: Authorizing `identity:create_grant(project_id=55faf272643648349c655751011854b8, user_id=b04784c6c0684d8082b954cd4caf32bf, role_id=3e9fca7423f14eb999603c531dfb03b4)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:15.838903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ab01a-153c-4922-8340-45f061844911 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:15.853560 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 292/583] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:57:15 2022] PUT /identity/v3/projects/55faf272643648349c655751011854b8/users/b04784c6c0684d8082b954cd4caf32bf/roles/3e9fca7423f14eb999603c531dfb03b4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 18:57:16.590068 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19546bd2-a2b9-4689-8870-90377aeb6311 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:16.590587 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19546bd2-a2b9-4689-8870-90377aeb6311 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:16.590698 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19546bd2-a2b9-4689-8870-90377aeb6311 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:16.592147 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 292/584] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:16.597579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8f7bd-780b-4f0c-a0bd-885f6ad842e3 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:16.598456 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8f7bd-780b-4f0c-a0bd-885f6ad842e3 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:16.598939 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8f7bd-780b-4f0c-a0bd-885f6ad842e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:16.618033 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-69e8f7bd-780b-4f0c-a0bd-885f6ad842e3 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:16.619578 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-69e8f7bd-780b-4f0c-a0bd-885f6ad842e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:16.688484 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 293/585] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:16.714384 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19546bd2-a2b9-4689-8870-90377aeb6311 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:16.805415 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:16.823202 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19546bd2-a2b9-4689-8870-90377aeb6311 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:16.858830 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e1b5-0f2c-4d77-a967-0dcdeda1530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:16.859585 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e1b5-0f2c-4d77-a967-0dcdeda1530b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:16.859870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e1b5-0f2c-4d77-a967-0dcdeda1530b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:16.860143 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e1b5-0f2c-4d77-a967-0dcdeda1530b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:16.870588 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320e1b5-0f2c-4d77-a967-0dcdeda1530b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-d320e1b5-0f2c-4d77-a967-0dcdeda1530b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:16.878428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:16.879400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:16.880458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 293/586] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:16.886557 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8f7bd-780b-4f0c-a0bd-885f6ad842e3 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:16.902367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:16.994000 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8f7bd-780b-4f0c-a0bd-885f6ad842e3 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:17.029533 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39983f78-4a59-4c12-a5f4-c830f2813e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:17.030203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983f78-4a59-4c12-a5f4-c830f2813e24 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:17.030489 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983f78-4a59-4c12-a5f4-c830f2813e24 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:17.030844 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983f78-4a59-4c12-a5f4-c830f2813e24 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:17.031624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39983f78-4a59-4c12-a5f4-c830f2813e24 None admin] RBAC: Adding query filter params (name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:17.031934 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39983f78-4a59-4c12-a5f4-c830f2813e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:17.033312 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39983f78-4a59-4c12-a5f4-c830f2813e24 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:17.042021 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 294/587] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:17.047446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e1b5-0f2c-4d77-a967-0dcdeda1530b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:17.158765 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e1b5-0f2c-4d77-a967-0dcdeda1530b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:17.194218 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7732550-1392-4160-9e3a-904295692fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:17.195002 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732550-1392-4160-9e3a-904295692fc5 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:17.195401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732550-1392-4160-9e3a-904295692fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:17.196382 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732550-1392-4160-9e3a-904295692fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:17.207725 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7732550-1392-4160-9e3a-904295692fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:17.209171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7732550-1392-4160-9e3a-904295692fc5 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:17.215879 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-a7732550-1392-4160-9e3a-904295692fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:17.227726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:17.231144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:17.233235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:17.233235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:17.233235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:17.233235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:17.233235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 294/588] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:17.235421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39983f78-4a59-4c12-a5f4-c830f2813e24 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:17.322257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:17.346567 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39983f78-4a59-4c12-a5f4-c830f2813e24 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:17.390701 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c0ea-3bd9-4fff-8bc6-f24136ab6c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:17.391425 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c0ea-3bd9-4fff-8bc6-f24136ab6c41 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:17.391712 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c0ea-3bd9-4fff-8bc6-f24136ab6c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:17.391991 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c0ea-3bd9-4fff-8bc6-f24136ab6c41 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:17.392719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c0ea-3bd9-4fff-8bc6-f24136ab6c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:17.393032 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c0ea-3bd9-4fff-8bc6-f24136ab6c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:17.394416 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c0ea-3bd9-4fff-8bc6-f24136ab6c41 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:17.407740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 295/589] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:17.412878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7732550-1392-4160-9e3a-904295692fc5 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:17.527409 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7732550-1392-4160-9e3a-904295692fc5 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:17.572720 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6067e85-8ab5-4d98-a1a1-28738ab79b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:17.573827 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6067e85-8ab5-4d98-a1a1-28738ab79b32 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:17.574326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6067e85-8ab5-4d98-a1a1-28738ab79b32 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:17.574798 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6067e85-8ab5-4d98-a1a1-28738ab79b32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:17.583327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6067e85-8ab5-4d98-a1a1-28738ab79b32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:17.585130 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6067e85-8ab5-4d98-a1a1-28738ab79b32 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-a6067e85-8ab5-4d98-a1a1-28738ab79b32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:17.601009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:17.602439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:17.603414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:17.603414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:17.603414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:17.603414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:17.603414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:17.603414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:17.603414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:17.603414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:17.603414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:17.603414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:17.605838 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 295/590] 10.222.0.98 () {56 vars in 1093 bytes} [Mon Jul 25 18:57:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:17.612253 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c0ea-3bd9-4fff-8bc6-f24136ab6c41 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:17.694449 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04130f18-c8e2-471c-a8f6-a7d5f7a53604 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:17.697287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04130f18-c8e2-471c-a8f6-a7d5f7a53604 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:17.697287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04130f18-c8e2-471c-a8f6-a7d5f7a53604 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:17.697287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 296/591] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:17.702914 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c18f7e-149f-430d-b177-9e79b6b63fe0 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:17.703233 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c18f7e-149f-430d-b177-9e79b6b63fe0 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:17.703514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c18f7e-149f-430d-b177-9e79b6b63fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:17.722792 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c0ea-3bd9-4fff-8bc6-f24136ab6c41 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:17.724189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-e0c18f7e-149f-430d-b177-9e79b6b63fe0 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:17.726043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-e0c18f7e-149f-430d-b177-9e79b6b63fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:17.773886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49af61d-5036-4cd8-8d00-7cd15d4dc916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:17.775462 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af61d-5036-4cd8-8d00-7cd15d4dc916 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:17.775762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af61d-5036-4cd8-8d00-7cd15d4dc916 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:17.776038 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af61d-5036-4cd8-8d00-7cd15d4dc916 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:17.776898 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49af61d-5036-4cd8-8d00-7cd15d4dc916 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:17.777208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49af61d-5036-4cd8-8d00-7cd15d4dc916 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:17.778840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49af61d-5036-4cd8-8d00-7cd15d4dc916 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:17.781869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:17.794863 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:17.803234 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 296/592] 10.222.0.98 () {56 vars in 1133 bytes} [Mon Jul 25 18:57:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:17.805643 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49af61d-5036-4cd8-8d00-7cd15d4dc916 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:17.813606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 297/593] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:17.846094 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c18f7e-149f-430d-b177-9e79b6b63fe0 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:17.920816 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49af61d-5036-4cd8-8d00-7cd15d4dc916 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:17.957400 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd511dde-4827-4e28-b312-8e6e15cd54d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:17.958056 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511dde-4827-4e28-b312-8e6e15cd54d7 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:17.958342 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511dde-4827-4e28-b312-8e6e15cd54d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:17.958620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511dde-4827-4e28-b312-8e6e15cd54d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:17.972452 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c18f7e-149f-430d-b177-9e79b6b63fe0 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:18.009653 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89f982-ed61-4743-a4ba-11e0559efc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:18.010454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f982-ed61-4743-a4ba-11e0559efc2e None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.010740 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f982-ed61-4743-a4ba-11e0559efc2e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.011016 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f982-ed61-4743-a4ba-11e0559efc2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.021713 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89f982-ed61-4743-a4ba-11e0559efc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:18.027637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-9a89f982-ed61-4743-a4ba-11e0559efc2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:18.030343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:18.031347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:18.032184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:18.036478 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 298/594] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:18.037351 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd511dde-4827-4e28-b312-8e6e15cd54d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:18.037792 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566adbff-7fa4-478d-ba39-5fd9d5af5914 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.038089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566adbff-7fa4-478d-ba39-5fd9d5af5914 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.038370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566adbff-7fa4-478d-ba39-5fd9d5af5914 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.038902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd511dde-4827-4e28-b312-8e6e15cd54d7 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:18.043412 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 299/595] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:18.043412 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566adbff-7fa4-478d-ba39-5fd9d5af5914 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:18.098166 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:18.160714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566adbff-7fa4-478d-ba39-5fd9d5af5914 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:18.161710 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 297/596] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 18:57:18.163617 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efad8b-a6ac-431b-9918-8839b96dd3b0 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.163984 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efad8b-a6ac-431b-9918-8839b96dd3b0 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.164584 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efad8b-a6ac-431b-9918-8839b96dd3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.191158 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-53efad8b-a6ac-431b-9918-8839b96dd3b0 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:18.192406 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-53efad8b-a6ac-431b-9918-8839b96dd3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:18.200210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5741446-ae7b-4761-a15a-2bc38796a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:18.200878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5741446-ae7b-4761-a15a-2bc38796a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.201162 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5741446-ae7b-4761-a15a-2bc38796a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.201434 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5741446-ae7b-4761-a15a-2bc38796a3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.202180 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5741446-ae7b-4761-a15a-2bc38796a3f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:18.202496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5741446-ae7b-4761-a15a-2bc38796a3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:18.203895 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5741446-ae7b-4761-a15a-2bc38796a3f7 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:18.217242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 300/597] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:18.217242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5741446-ae7b-4761-a15a-2bc38796a3f7 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:18.275206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 298/598] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:18.276517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efad8b-a6ac-431b-9918-8839b96dd3b0 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:18.310598 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:18.320191 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5741446-ae7b-4761-a15a-2bc38796a3f7 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:18.331285 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:18.355634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdc351-64e5-48e8-b6e5-6ea9e67380bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:18.356444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdc351-64e5-48e8-b6e5-6ea9e67380bd None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.356732 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdc351-64e5-48e8-b6e5-6ea9e67380bd None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.357006 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdc351-64e5-48e8-b6e5-6ea9e67380bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.367543 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdc351-64e5-48e8-b6e5-6ea9e67380bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:18.369011 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdc351-64e5-48e8-b6e5-6ea9e67380bd None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-10cdc351-64e5-48e8-b6e5-6ea9e67380bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:18.388545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:18.389474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:18.390359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:18.390359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:18.390359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:18.390359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:18.390591 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efad8b-a6ac-431b-9918-8839b96dd3b0 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:18.390665 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 301/599] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:18.391392 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ac664-a81c-458f-842d-b0428e740c33 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.391392 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ac664-a81c-458f-842d-b0428e740c33 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.391677 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ac664-a81c-458f-842d-b0428e740c33 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.393068 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 302/600] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:18.393663 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ac664-a81c-458f-842d-b0428e740c33 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:18.428817 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f572f-105d-4631-b497-b4c263504f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:18.429612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f572f-105d-4631-b497-b4c263504f49 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.430444 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f572f-105d-4631-b497-b4c263504f49 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.430719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f572f-105d-4631-b497-b4c263504f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.440775 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f572f-105d-4631-b497-b4c263504f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:18.442231 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f572f-105d-4631-b497-b4c263504f49 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-775f572f-105d-4631-b497-b4c263504f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:18.460894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:18.461849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:18.462766 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:18.462766 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:18.462766 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:18.462766 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:18.462766 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 299/601] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:18.463050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f572f-105d-4631-b497-b4c263504f49 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:18.504454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ac664-a81c-458f-842d-b0428e740c33 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:18.537966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab849cd-d1c5-46bf-8f18-659066dd308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:18.538756 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab849cd-d1c5-46bf-8f18-659066dd308a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.539071 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab849cd-d1c5-46bf-8f18-659066dd308a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.539533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab849cd-d1c5-46bf-8f18-659066dd308a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.542595 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:18.552875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab849cd-d1c5-46bf-8f18-659066dd308a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-2ab849cd-d1c5-46bf-8f18-659066dd308a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:18.561379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:18.562317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:18.563563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 303/602] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:18.564415 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc1d72-4898-4693-8401-161a4bf74d29 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.564503 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc1d72-4898-4693-8401-161a4bf74d29 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.564735 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc1d72-4898-4693-8401-161a4bf74d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.571864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f572f-105d-4631-b497-b4c263504f49 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:18.582873 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-fcdc1d72-4898-4693-8401-161a4bf74d29 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:18.584128 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-fcdc1d72-4898-4693-8401-161a4bf74d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:18.600239 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:18.605899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70eefa-0fd6-4e11-acda-786a8338c6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:18.606559 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70eefa-0fd6-4e11-acda-786a8338c6b8 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.606849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70eefa-0fd6-4e11-acda-786a8338c6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.607155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70eefa-0fd6-4e11-acda-786a8338c6b8 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.607879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70eefa-0fd6-4e11-acda-786a8338c6b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:18.608189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70eefa-0fd6-4e11-acda-786a8338c6b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:18.609598 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70eefa-0fd6-4e11-acda-786a8338c6b8 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:18.621809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 300/603] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:18.622608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70eefa-0fd6-4e11-acda-786a8338c6b8 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:18.654361 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 304/604] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:18.655229 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc1d72-4898-4693-8401-161a4bf74d29 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:18.733343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70eefa-0fd6-4e11-acda-786a8338c6b8 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:18.759757 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc1d72-4898-4693-8401-161a4bf74d29 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:18.772151 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103876ee-765f-4934-95a4-f488a12aae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:18.772815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103876ee-765f-4934-95a4-f488a12aae6c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.773101 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103876ee-765f-4934-95a4-f488a12aae6c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.773376 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103876ee-765f-4934-95a4-f488a12aae6c None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.774279 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103876ee-765f-4934-95a4-f488a12aae6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:18.774590 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103876ee-765f-4934-95a4-f488a12aae6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:18.776009 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103876ee-765f-4934-95a4-f488a12aae6c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:18.778253 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:18.788027 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 301/605] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:18.788823 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103876ee-765f-4934-95a4-f488a12aae6c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:18.798675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674c44-b997-4226-ae05-3eb6623ea201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:18.799372 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674c44-b997-4226-ae05-3eb6623ea201 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.799656 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674c44-b997-4226-ae05-3eb6623ea201 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.799931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674c44-b997-4226-ae05-3eb6623ea201 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.800666 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35674c44-b997-4226-ae05-3eb6623ea201 None admin] RBAC: Adding query filter params (name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:18.800997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35674c44-b997-4226-ae05-3eb6623ea201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:18.802347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35674c44-b997-4226-ae05-3eb6623ea201 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:18.810939 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 305/606] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:18.811873 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674c44-b997-4226-ae05-3eb6623ea201 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:18.828853 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:18.892629 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103876ee-765f-4934-95a4-f488a12aae6c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:18.913480 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674c44-b997-4226-ae05-3eb6623ea201 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:18.926733 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771c112-4be5-492e-9fa5-e493da1d3f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:18.927574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771c112-4be5-492e-9fa5-e493da1d3f78 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.927862 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771c112-4be5-492e-9fa5-e493da1d3f78 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.928143 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771c112-4be5-492e-9fa5-e493da1d3f78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.935473 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771c112-4be5-492e-9fa5-e493da1d3f78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:18.937038 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771c112-4be5-492e-9fa5-e493da1d3f78 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:18.947605 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841be1c-b47d-4654-ad71-41689989b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:18.948394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841be1c-b47d-4654-ad71-41689989b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:18.948677 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841be1c-b47d-4654-ad71-41689989b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:18.948950 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841be1c-b47d-4654-ad71-41689989b4b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-2771c112-4be5-492e-9fa5-e493da1d3f78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:18.951840 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:18.952740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:18.953642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:18.953642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:18.953642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:18.953642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:18.953642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:18.953642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:18.953642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:18.953642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:18.953642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 302/607] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:18.954140 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771c112-4be5-492e-9fa5-e493da1d3f78 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:18.960473 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841be1c-b47d-4654-ad71-41689989b4b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-f841be1c-b47d-4654-ad71-41689989b4b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:18.968371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:18.969319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:18.970174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 306/608] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:18.971468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841be1c-b47d-4654-ad71-41689989b4b4 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.018208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:19.046310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:19.063270 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771c112-4be5-492e-9fa5-e493da1d3f78 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.072232 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841be1c-b47d-4654-ad71-41689989b4b4 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.097714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5750-071d-46a4-9310-3da116a9122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.098529 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5750-071d-46a4-9310-3da116a9122a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.098813 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5750-071d-46a4-9310-3da116a9122a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.099087 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5750-071d-46a4-9310-3da116a9122a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.105398 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba88455-c688-4d51-a0bd-32b35f73dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.106182 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba88455-c688-4d51-a0bd-32b35f73dea7 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.106465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba88455-c688-4d51-a0bd-32b35f73dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.106740 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba88455-c688-4d51-a0bd-32b35f73dea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.106849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a5750-071d-46a4-9310-3da116a9122a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.108265 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a5750-071d-46a4-9310-3da116a9122a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:19.117851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba88455-c688-4d51-a0bd-32b35f73dea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.119452 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba88455-c688-4d51-a0bd-32b35f73dea7 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-bd3a5750-071d-46a4-9310-3da116a9122a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:19.124732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:19.125835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:19.126758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 303/609] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:19.127389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5750-071d-46a4-9310-3da116a9122a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-4ba88455-c688-4d51-a0bd-32b35f73dea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:19.139444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:19.140319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:19.141273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:19.141273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:19.141273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:19.141273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:19.141273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 307/610] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:19.141950 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba88455-c688-4d51-a0bd-32b35f73dea7 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.232853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5750-071d-46a4-9310-3da116a9122a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.242620 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba88455-c688-4d51-a0bd-32b35f73dea7 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.250648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:19.268295 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:19.270081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197a63-8427-4983-8078-d5b2e5af9772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.270879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197a63-8427-4983-8078-d5b2e5af9772 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.271190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197a63-8427-4983-8078-d5b2e5af9772 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.271472 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197a63-8427-4983-8078-d5b2e5af9772 None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.272247 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2197a63-8427-4983-8078-d5b2e5af9772 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:19.272561 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2197a63-8427-4983-8078-d5b2e5af9772 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.274643 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2197a63-8427-4983-8078-d5b2e5af9772 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:19.278292 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db073d9-1210-470c-bcd1-b5622768148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.278951 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db073d9-1210-470c-bcd1-b5622768148e None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.279267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db073d9-1210-470c-bcd1-b5622768148e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.279544 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db073d9-1210-470c-bcd1-b5622768148e None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.280286 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db073d9-1210-470c-bcd1-b5622768148e None admin] RBAC: Adding query filter params (name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:19.280590 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db073d9-1210-470c-bcd1-b5622768148e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.281935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db073d9-1210-470c-bcd1-b5622768148e None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:19.286078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 304/611] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:19.287038 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197a63-8427-4983-8078-d5b2e5af9772 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.291049 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 308/612] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:57:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:19.292349 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db073d9-1210-470c-bcd1-b5622768148e None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.391674 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197a63-8427-4983-8078-d5b2e5af9772 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.396583 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db073d9-1210-470c-bcd1-b5622768148e None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.426115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410d090-7328-4fe0-aa1c-2c4d15cd23f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.426787 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410d090-7328-4fe0-aa1c-2c4d15cd23f6 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.427071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410d090-7328-4fe0-aa1c-2c4d15cd23f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.427377 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410d090-7328-4fe0-aa1c-2c4d15cd23f6 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.428199 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410d090-7328-4fe0-aa1c-2c4d15cd23f6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:19.428510 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410d090-7328-4fe0-aa1c-2c4d15cd23f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.430145 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410d090-7328-4fe0-aa1c-2c4d15cd23f6 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:19.431413 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fe84f-b7ed-4fe0-ae54-9db998e3a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.432072 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fe84f-b7ed-4fe0-ae54-9db998e3a726 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.432355 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fe84f-b7ed-4fe0-ae54-9db998e3a726 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.432638 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fe84f-b7ed-4fe0-ae54-9db998e3a726 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.433349 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fe84f-b7ed-4fe0-ae54-9db998e3a726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:19.433663 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fe84f-b7ed-4fe0-ae54-9db998e3a726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.435007 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fe84f-b7ed-4fe0-ae54-9db998e3a726 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:19.447033 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 305/613] 10.222.0.98 () {56 vars in 1137 bytes} [Mon Jul 25 18:57:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:19.452229 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 309/614] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:19.452388 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410d090-7328-4fe0-aa1c-2c4d15cd23f6 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.452485 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fe84f-b7ed-4fe0-ae54-9db998e3a726 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.486057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:19.500898 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:19.554371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fe84f-b7ed-4fe0-ae54-9db998e3a726 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.556860 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410d090-7328-4fe0-aa1c-2c4d15cd23f6 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.591505 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae252-6504-489d-908f-61b81d8c10c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.592299 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae252-6504-489d-908f-61b81d8c10c1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.592582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae252-6504-489d-908f-61b81d8c10c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.592855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae252-6504-489d-908f-61b81d8c10c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.599251 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807df6-fe10-485f-8bca-bb6620941f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.599900 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807df6-fe10-485f-8bca-bb6620941f9f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.600180 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807df6-fe10-485f-8bca-bb6620941f9f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.600462 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807df6-fe10-485f-8bca-bb6620941f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.601280 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6807df6-fe10-485f-8bca-bb6620941f9f None admin] RBAC: Adding query filter params (role.id=3e9fca7423f14eb999603c531dfb03b4, scope.project.id=55faf272643648349c655751011854b8, user.id=6aa237d6badd493a9f2a75bf4086fec3) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:19.601621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6807df6-fe10-485f-8bca-bb6620941f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.603044 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6807df6-fe10-485f-8bca-bb6620941f9f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:19.603297 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ae252-6504-489d-908f-61b81d8c10c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.604906 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ae252-6504-489d-908f-61b81d8c10c1 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:19.608869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 306/615] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:57:19 2022] GET /identity/v3/role_assignments?user.id=6aa237d6badd493a9f2a75bf4086fec3&scope.project.id=55faf272643648349c655751011854b8&role.id=3e9fca7423f14eb999603c531dfb03b4 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:19.609727 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807df6-fe10-485f-8bca-bb6620941f9f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-3e9ae252-6504-489d-908f-61b81d8c10c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:19.623370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:19.624662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:19.625545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:19.625545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:19.625545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:19.625545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:19.625545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 310/616] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:19.625545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae252-6504-489d-908f-61b81d8c10c1 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.741977 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:19.747837 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:19.748357 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807df6-fe10-485f-8bca-bb6620941f9f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.752358 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae252-6504-489d-908f-61b81d8c10c1 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.789005 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a805c5c-51df-4f0a-9473-bb0c84634865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.789357 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a805c5c-51df-4f0a-9473-bb0c84634865 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.789650 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a805c5c-51df-4f0a-9473-bb0c84634865 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.790037 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a805c5c-51df-4f0a-9473-bb0c84634865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.795748 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ea8bd-9256-4bfe-9602-97c14f539585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.796255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ea8bd-9256-4bfe-9602-97c14f539585 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.796544 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ea8bd-9256-4bfe-9602-97c14f539585 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.797509 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ea8bd-9256-4bfe-9602-97c14f539585 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.811726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ea8bd-9256-4bfe-9602-97c14f539585 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.812385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ea8bd-9256-4bfe-9602-97c14f539585 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-aa3ea8bd-9256-4bfe-9602-97c14f539585 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:19.828582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:19.829697 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:19.830729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 311/617] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:57:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:19.831396 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ea8bd-9256-4bfe-9602-97c14f539585 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.875638 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a805c5c-51df-4f0a-9473-bb0c84634865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.877125 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a805c5c-51df-4f0a-9473-bb0c84634865 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:19.953548 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ea8bd-9256-4bfe-9602-97c14f539585 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:19.985258 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:19.995175 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 307/618] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:57:19.995175 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a805c5c-51df-4f0a-9473-bb0c84634865 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:19.996268 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11745cb1-b07a-41e6-9484-5da9e9022ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:19.996947 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11745cb1-b07a-41e6-9484-5da9e9022ba8 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:19.997236 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11745cb1-b07a-41e6-9484-5da9e9022ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:19.997515 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11745cb1-b07a-41e6-9484-5da9e9022ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:19.998242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11745cb1-b07a-41e6-9484-5da9e9022ba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:19.998551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11745cb1-b07a-41e6-9484-5da9e9022ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:19.999961 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11745cb1-b07a-41e6-9484-5da9e9022ba8 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:20.017902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 312/619] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:20.017902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11745cb1-b07a-41e6-9484-5da9e9022ba8 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:20.040917 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:20.097042 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a805c5c-51df-4f0a-9473-bb0c84634865 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:20.129258 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11745cb1-b07a-41e6-9484-5da9e9022ba8 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:20.135965 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce525a-13d2-4e52-94c6-eca117440cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:20.136639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce525a-13d2-4e52-94c6-eca117440cde None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:20.136921 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce525a-13d2-4e52-94c6-eca117440cde None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:20.137195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce525a-13d2-4e52-94c6-eca117440cde None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:20.138028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce525a-13d2-4e52-94c6-eca117440cde None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:20.138335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce525a-13d2-4e52-94c6-eca117440cde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:20.139859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce525a-13d2-4e52-94c6-eca117440cde None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:20.157718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 308/620] 10.222.0.98 () {56 vars in 1137 bytes} [Mon Jul 25 18:57:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:20.158551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce525a-13d2-4e52-94c6-eca117440cde None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:20.174326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588263a-d2bd-408c-9b22-7e4e5abeab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:20.175492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588263a-d2bd-408c-9b22-7e4e5abeab0f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:20.175807 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588263a-d2bd-408c-9b22-7e4e5abeab0f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:20.176114 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588263a-d2bd-408c-9b22-7e4e5abeab0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:20.189278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588263a-d2bd-408c-9b22-7e4e5abeab0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:20.191075 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588263a-d2bd-408c-9b22-7e4e5abeab0f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-f588263a-d2bd-408c-9b22-7e4e5abeab0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:20.210181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:20.211220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:20.212199 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:20.212199 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:20.212199 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:20.212199 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:20.218187 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 313/621] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:20.219225 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588263a-d2bd-408c-9b22-7e4e5abeab0f None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:20.222295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:20.273380 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce525a-13d2-4e52-94c6-eca117440cde None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:20.306081 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:20.310752 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f1b59-f88e-471a-bb7c-0c0e054e8a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:20.311581 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f1b59-f88e-471a-bb7c-0c0e054e8a2f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:20.311867 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f1b59-f88e-471a-bb7c-0c0e054e8a2f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:20.312134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f1b59-f88e-471a-bb7c-0c0e054e8a2f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:20.320421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f1b59-f88e-471a-bb7c-0c0e054e8a2f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:20.322010 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f1b59-f88e-471a-bb7c-0c0e054e8a2f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-134f1b59-f88e-471a-bb7c-0c0e054e8a2f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:20.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:20.338071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:20.339034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:20.339034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:20.339034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:20.339034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:20.339034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:20.339034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:20.339034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:20.339034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:20.339034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 18:57:20.339034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:20.342906 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 309/622] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:57:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:20.343027 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588263a-d2bd-408c-9b22-7e4e5abeab0f None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:20.343777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f1b59-f88e-471a-bb7c-0c0e054e8a2f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:20.379419 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ba4be-956d-4863-bafe-f56eea45078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:20.379994 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ba4be-956d-4863-bafe-f56eea45078e None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:20.380435 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ba4be-956d-4863-bafe-f56eea45078e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:20.380721 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ba4be-956d-4863-bafe-f56eea45078e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:20.451172 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f1b59-f88e-471a-bb7c-0c0e054e8a2f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:20.462976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ba4be-956d-4863-bafe-f56eea45078e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:20.464761 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ba4be-956d-4863-bafe-f56eea45078e None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:20.468904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:20.489846 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132ec5b-7a89-47e3-aa15-2c086efa8c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:20.490519 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132ec5b-7a89-47e3-aa15-2c086efa8c1e None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:20.490805 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132ec5b-7a89-47e3-aa15-2c086efa8c1e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:20.491085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132ec5b-7a89-47e3-aa15-2c086efa8c1e None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:20.491835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132ec5b-7a89-47e3-aa15-2c086efa8c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:20.492174 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132ec5b-7a89-47e3-aa15-2c086efa8c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:20.494192 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132ec5b-7a89-47e3-aa15-2c086efa8c1e None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:20.507381 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 310/623] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:20.508746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132ec5b-7a89-47e3-aa15-2c086efa8c1e None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:20.539292 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:20.572492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 314/624] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:57:20.573539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ba4be-956d-4863-bafe-f56eea45078e None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:20.628150 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132ec5b-7a89-47e3-aa15-2c086efa8c1e None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:20.663564 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6b649-c12d-4458-b26c-4052e4bf0974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:20.664243 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6b649-c12d-4458-b26c-4052e4bf0974 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:20.664531 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6b649-c12d-4458-b26c-4052e4bf0974 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:20.664944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6b649-c12d-4458-b26c-4052e4bf0974 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:20.665781 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6b649-c12d-4458-b26c-4052e4bf0974 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:20.666093 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6b649-c12d-4458-b26c-4052e4bf0974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:20.667598 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6b649-c12d-4458-b26c-4052e4bf0974 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:20.689311 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ba4be-956d-4863-bafe-f56eea45078e None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:20.694229 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 311/625] 10.222.0.98 () {56 vars in 1139 bytes} [Mon Jul 25 18:57:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:20.695079 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6b649-c12d-4458-b26c-4052e4bf0974 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:20.729020 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf746df-76af-46b1-8616-96fb5ed9c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:20.729823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf746df-76af-46b1-8616-96fb5ed9c26b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:20.730108 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf746df-76af-46b1-8616-96fb5ed9c26b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:20.730384 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf746df-76af-46b1-8616-96fb5ed9c26b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:20.733712 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:20.737452 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf746df-76af-46b1-8616-96fb5ed9c26b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:20.738886 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf746df-76af-46b1-8616-96fb5ed9c26b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-3bf746df-76af-46b1-8616-96fb5ed9c26b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:20.753864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:20.755266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:20.756189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:20.756189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:20.756189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:20.756189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:20.756189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:20.756189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:20.756189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:20.756189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:20.756189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 315/626] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:20.756189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf746df-76af-46b1-8616-96fb5ed9c26b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:20.790830 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:20.818136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6b649-c12d-4458-b26c-4052e4bf0974 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:20.857782 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51953ca-2b3c-4016-8908-8c99dba43f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:20.858583 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51953ca-2b3c-4016-8908-8c99dba43f10 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:20.858876 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51953ca-2b3c-4016-8908-8c99dba43f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:20.859185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51953ca-2b3c-4016-8908-8c99dba43f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:20.870570 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51953ca-2b3c-4016-8908-8c99dba43f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:20.872078 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51953ca-2b3c-4016-8908-8c99dba43f10 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:20.872752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf746df-76af-46b1-8616-96fb5ed9c26b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-c51953ca-2b3c-4016-8908-8c99dba43f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:20.892424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:20.893401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:20.900363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:20.900363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:20.900363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:20.900363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:20.900363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 312/627] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:20.900363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51953ca-2b3c-4016-8908-8c99dba43f10 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:20.917456 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5f5b-31d2-4016-b4f3-5152160f7881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:20.918032 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5f5b-31d2-4016-b4f3-5152160f7881 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:20.918320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5f5b-31d2-4016-b4f3-5152160f7881 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:20.918602 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5f5b-31d2-4016-b4f3-5152160f7881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:20.988435 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:20.990022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a5f5b-31d2-4016-b4f3-5152160f7881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:20.991693 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a5f5b-31d2-4016-b4f3-5152160f7881 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:21.005239 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51953ca-2b3c-4016-8908-8c99dba43f10 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:21.025797 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:21.043402 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69aee8-fd63-488f-8cc1-396742fea057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:21.044290 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69aee8-fd63-488f-8cc1-396742fea057 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.044426 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69aee8-fd63-488f-8cc1-396742fea057 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.044619 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69aee8-fd63-488f-8cc1-396742fea057 None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:21.045405 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69aee8-fd63-488f-8cc1-396742fea057 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:21.045719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69aee8-fd63-488f-8cc1-396742fea057 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:21.047357 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69aee8-fd63-488f-8cc1-396742fea057 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:21.060241 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 313/628] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:21.061050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69aee8-fd63-488f-8cc1-396742fea057 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:21.108464 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 316/629] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:57:21.109864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5f5b-31d2-4016-b4f3-5152160f7881 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:21.176071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69aee8-fd63-488f-8cc1-396742fea057 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:21.212257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8019-6ed5-4fb2-b143-da8f69489846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:21.212931 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8019-6ed5-4fb2-b143-da8f69489846 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.213221 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8019-6ed5-4fb2-b143-da8f69489846 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.213503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8019-6ed5-4fb2-b143-da8f69489846 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:21.214220 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db8019-6ed5-4fb2-b143-da8f69489846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:21.214534 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db8019-6ed5-4fb2-b143-da8f69489846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:21.215306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5f5b-31d2-4016-b4f3-5152160f7881 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:21.215939 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db8019-6ed5-4fb2-b143-da8f69489846 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:21.233177 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 314/630] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:21.233177 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8019-6ed5-4fb2-b143-da8f69489846 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:21.240009 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:21.252212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:21.258539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62e817-6c46-4102-93b8-b2f190698fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:21.259672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62e817-6c46-4102-93b8-b2f190698fb9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.260138 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62e817-6c46-4102-93b8-b2f190698fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.260420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62e817-6c46-4102-93b8-b2f190698fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:21.261286 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62e817-6c46-4102-93b8-b2f190698fb9 None admin] RBAC: Adding query filter params (role.id=3e9fca7423f14eb999603c531dfb03b4, scope.project.id=55faf272643648349c655751011854b8, user.id=c000c774dc134acabf8abaa701de3be4) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:21.261582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62e817-6c46-4102-93b8-b2f190698fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:21.263014 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62e817-6c46-4102-93b8-b2f190698fb9 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:21.279162 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 317/631] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:57:21 2022] GET /identity/v3/role_assignments?user.id=c000c774dc134acabf8abaa701de3be4&scope.project.id=55faf272643648349c655751011854b8&role.id=3e9fca7423f14eb999603c531dfb03b4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:21.279162 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62e817-6c46-4102-93b8-b2f190698fb9 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:21.361285 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8019-6ed5-4fb2-b143-da8f69489846 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:21.401826 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb2c9a-4a91-4bff-8600-4d57a1ee74e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:21.403597 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb2c9a-4a91-4bff-8600-4d57a1ee74e9 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.403887 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb2c9a-4a91-4bff-8600-4d57a1ee74e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.404169 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb2c9a-4a91-4bff-8600-4d57a1ee74e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:21.405932 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62e817-6c46-4102-93b8-b2f190698fb9 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:21.420291 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb2c9a-4a91-4bff-8600-4d57a1ee74e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:21.421785 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb2c9a-4a91-4bff-8600-4d57a1ee74e9 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-1cbb2c9a-4a91-4bff-8600-4d57a1ee74e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:21.441430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:21.442392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:21.443341 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:21.443341 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:21.443341 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:21.443341 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:21.443341 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 315/632] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:21.451994 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb2c9a-4a91-4bff-8600-4d57a1ee74e9 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:21.465892 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9760bc-39dd-46e8-940e-8de605c6eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:21.466714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9760bc-39dd-46e8-940e-8de605c6eced None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.467000 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9760bc-39dd-46e8-940e-8de605c6eced None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.467366 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9760bc-39dd-46e8-940e-8de605c6eced None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:21.475201 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9760bc-39dd-46e8-940e-8de605c6eced None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:21.477418 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9760bc-39dd-46e8-940e-8de605c6eced None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-0f9760bc-39dd-46e8-940e-8de605c6eced None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:21.494586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:21.495572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:21.496445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:21.496445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:21.496445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:21.496445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:21.496445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:21.496445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:21.496445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:21.496445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:21.497385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 318/633] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:21.503918 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9760bc-39dd-46e8-940e-8de605c6eced None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:21.539692 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:21.587562 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:21.600583 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb2c9a-4a91-4bff-8600-4d57a1ee74e9 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:21.649904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4464b0-fcd2-4ebb-9f85-ec8d1ef04ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:21.650732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4464b0-fcd2-4ebb-9f85-ec8d1ef04ddf None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.651021 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4464b0-fcd2-4ebb-9f85-ec8d1ef04ddf None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.651330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4464b0-fcd2-4ebb-9f85-ec8d1ef04ddf None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:21.652060 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4464b0-fcd2-4ebb-9f85-ec8d1ef04ddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:21.652372 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4464b0-fcd2-4ebb-9f85-ec8d1ef04ddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:21.653765 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4464b0-fcd2-4ebb-9f85-ec8d1ef04ddf None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:21.661200 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9760bc-39dd-46e8-940e-8de605c6eced None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:21.668651 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 316/634] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:21.678145 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4464b0-fcd2-4ebb-9f85-ec8d1ef04ddf None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:21.705700 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac913e91-cf7b-4bb1-8725-d703ebf6ae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:21.706550 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac913e91-cf7b-4bb1-8725-d703ebf6ae73 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.706943 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac913e91-cf7b-4bb1-8725-d703ebf6ae73 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.707379 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac913e91-cf7b-4bb1-8725-d703ebf6ae73 None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:21.708313 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac913e91-cf7b-4bb1-8725-d703ebf6ae73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:21.708777 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac913e91-cf7b-4bb1-8725-d703ebf6ae73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:21.710384 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac913e91-cf7b-4bb1-8725-d703ebf6ae73 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:21.725137 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 319/635] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:21.731064 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac913e91-cf7b-4bb1-8725-d703ebf6ae73 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:21.812978 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4464b0-fcd2-4ebb-9f85-ec8d1ef04ddf None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:21.834686 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:21.856007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb1960-ebd6-48e5-bd43-ecfb34b4c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:21.856217 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac913e91-cf7b-4bb1-8725-d703ebf6ae73 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:21.857608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb1960-ebd6-48e5-bd43-ecfb34b4c193 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.858196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb1960-ebd6-48e5-bd43-ecfb34b4c193 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.858699 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb1960-ebd6-48e5-bd43-ecfb34b4c193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:21.866370 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb1960-ebd6-48e5-bd43-ecfb34b4c193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:21.868318 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb1960-ebd6-48e5-bd43-ecfb34b4c193 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:21.875555 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-7acb1960-ebd6-48e5-bd43-ecfb34b4c193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:21.884454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:21.885610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:21.886507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:21.886507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:21.886507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:21.886507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:21.886507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:21.886507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:21.886507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:21.886507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:21.893673 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 317/636] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:21.894847 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb1960-ebd6-48e5-bd43-ecfb34b4c193 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:21.895947 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aeb252-7caf-4a89-af61-decdd316461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:21.896616 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aeb252-7caf-4a89-af61-decdd316461d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.896903 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aeb252-7caf-4a89-af61-decdd316461d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.897184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aeb252-7caf-4a89-af61-decdd316461d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:21.898022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aeb252-7caf-4a89-af61-decdd316461d None admin] RBAC: Adding query filter params (role.id=3e9fca7423f14eb999603c531dfb03b4, scope.project.id=55faf272643648349c655751011854b8, user.id=1e21b5991e7345149a4d0e644a436099) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:21.898487 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aeb252-7caf-4a89-af61-decdd316461d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:21.900932 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aeb252-7caf-4a89-af61-decdd316461d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:21.908861 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 320/637] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:57:21 2022] GET /identity/v3/role_assignments?user.id=1e21b5991e7345149a4d0e644a436099&scope.project.id=55faf272643648349c655751011854b8&role.id=3e9fca7423f14eb999603c531dfb03b4 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:21.973009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d3752-58b9-48b9-899d-8b97e69eddd0 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.973299 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d3752-58b9-48b9-899d-8b97e69eddd0 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.973492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d3752-58b9-48b9-899d-8b97e69eddd0 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:21.974872 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 321/638] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:21.980816 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d516c-13c1-48f5-b230-f392d25eef97 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:21.981111 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d516c-13c1-48f5-b230-f392d25eef97 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:21.981383 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d516c-13c1-48f5-b230-f392d25eef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:22.002301 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-990d516c-13c1-48f5-b230-f392d25eef97 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:22.003847 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-990d516c-13c1-48f5-b230-f392d25eef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:22.029853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb1960-ebd6-48e5-bd43-ecfb34b4c193 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:22.076946 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04fb25-5762-4bc7-a834-b4cc46a8e114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:22.077776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04fb25-5762-4bc7-a834-b4cc46a8e114 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:22.078052 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04fb25-5762-4bc7-a834-b4cc46a8e114 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:22.078341 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04fb25-5762-4bc7-a834-b4cc46a8e114 None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:22.079188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04fb25-5762-4bc7-a834-b4cc46a8e114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:22.079487 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04fb25-5762-4bc7-a834-b4cc46a8e114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:22.080974 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04fb25-5762-4bc7-a834-b4cc46a8e114 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:22.082208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 322/639] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:57:22.102118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 318/640] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:22.107115 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d516c-13c1-48f5-b230-f392d25eef97 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:22.108794 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04fb25-5762-4bc7-a834-b4cc46a8e114 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:22.161884 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:22.246771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04fb25-5762-4bc7-a834-b4cc46a8e114 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:22.250478 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d516c-13c1-48f5-b230-f392d25eef97 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:22.266368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:22.283869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0411-3426-4519-9844-1451c3315534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:22.284377 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0411-3426-4519-9844-1451c3315534 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:22.284669 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0411-3426-4519-9844-1451c3315534 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:22.284957 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0411-3426-4519-9844-1451c3315534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:22.285790 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e0411-3426-4519-9844-1451c3315534 None admin] RBAC: Adding query filter params (role.id=3e9fca7423f14eb999603c531dfb03b4, scope.project.id=55faf272643648349c655751011854b8, user.id=b04784c6c0684d8082b954cd4caf32bf) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:22.286106 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e0411-3426-4519-9844-1451c3315534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:22.287684 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e0411-3426-4519-9844-1451c3315534 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:22.295084 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 319/641] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:57:22 2022] GET /identity/v3/role_assignments?user.id=b04784c6c0684d8082b954cd4caf32bf&scope.project.id=55faf272643648349c655751011854b8&role.id=3e9fca7423f14eb999603c531dfb03b4 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:22.297446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87cba8-cf7a-43ca-a32a-f2958ea6bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:22.298506 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87cba8-cf7a-43ca-a32a-f2958ea6bdbb None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:22.299015 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87cba8-cf7a-43ca-a32a-f2958ea6bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:22.299531 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87cba8-cf7a-43ca-a32a-f2958ea6bdbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:22.317641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87cba8-cf7a-43ca-a32a-f2958ea6bdbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-6a87cba8-cf7a-43ca-a32a-f2958ea6bdbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:22.326368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:22.327501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:22.328401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 323/642] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:57:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:22.335641 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0411-3426-4519-9844-1451c3315534 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:22.452258 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0411-3426-4519-9844-1451c3315534 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:22.454373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:22.490844 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bed78-efea-490b-8b72-647603d78db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:22.491547 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bed78-efea-490b-8b72-647603d78db2 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:22.491833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bed78-efea-490b-8b72-647603d78db2 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:22.492143 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bed78-efea-490b-8b72-647603d78db2 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:22.493392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bed78-efea-490b-8b72-647603d78db2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:22.493698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bed78-efea-490b-8b72-647603d78db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:22.495103 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bed78-efea-490b-8b72-647603d78db2 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:22.504243 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 320/643] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:57:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:22.510373 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87cba8-cf7a-43ca-a32a-f2958ea6bdbb None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:22.627576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87cba8-cf7a-43ca-a32a-f2958ea6bdbb None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:22.665394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cd371-6db6-4b37-9c23-421f4641b38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:22.666552 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cd371-6db6-4b37-9c23-421f4641b38a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:22.667056 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cd371-6db6-4b37-9c23-421f4641b38a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:22.667538 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cd371-6db6-4b37-9c23-421f4641b38a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:22.679563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cd371-6db6-4b37-9c23-421f4641b38a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:22.681923 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cd371-6db6-4b37-9c23-421f4641b38a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-515cd371-6db6-4b37-9c23-421f4641b38a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:22.703794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:22.704701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:22.705629 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:22.705629 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:22.705629 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:22.705629 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:22.705629 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 324/644] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:22.710771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bed78-efea-490b-8b72-647603d78db2 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:22.823392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bed78-efea-490b-8b72-647603d78db2 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:22.859408 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed897-f82a-49b0-96de-52243d7e32b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:22.860063 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed897-f82a-49b0-96de-52243d7e32b4 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:22.860354 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed897-f82a-49b0-96de-52243d7e32b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:22.860635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed897-f82a-49b0-96de-52243d7e32b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:22.861361 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed897-f82a-49b0-96de-52243d7e32b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:22.861670 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed897-f82a-49b0-96de-52243d7e32b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:22.863064 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed897-f82a-49b0-96de-52243d7e32b4 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:22.877637 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 321/645] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:22.883789 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cd371-6db6-4b37-9c23-421f4641b38a None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:22.911260 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:22.994881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cd371-6db6-4b37-9c23-421f4641b38a None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:23.031330 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8919c3-8fa0-4ac8-892e-af9a410ff045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:23.032123 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8919c3-8fa0-4ac8-892e-af9a410ff045 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:23.032411 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8919c3-8fa0-4ac8-892e-af9a410ff045 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:23.032686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8919c3-8fa0-4ac8-892e-af9a410ff045 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:23.041391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8919c3-8fa0-4ac8-892e-af9a410ff045 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:23.042845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8919c3-8fa0-4ac8-892e-af9a410ff045 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-af8919c3-8fa0-4ac8-892e-af9a410ff045 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:23.057637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:23.059858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:23.062119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 325/646] 10.222.0.98 () {56 vars in 1093 bytes} [Mon Jul 25 18:57:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:23.068210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed897-f82a-49b0-96de-52243d7e32b4 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:23.096567 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:23.179293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed897-f82a-49b0-96de-52243d7e32b4 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:23.217648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcb92d-f300-40f3-b68f-70bea91bcb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:23.218325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcb92d-f300-40f3-b68f-70bea91bcb50 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:23.218620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcb92d-f300-40f3-b68f-70bea91bcb50 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:23.218899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcb92d-f300-40f3-b68f-70bea91bcb50 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:23.219771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcb92d-f300-40f3-b68f-70bea91bcb50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:23.220093 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcb92d-f300-40f3-b68f-70bea91bcb50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:23.221551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcb92d-f300-40f3-b68f-70bea91bcb50 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:23.243543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 322/647] 10.222.0.98 () {56 vars in 1133 bytes} [Mon Jul 25 18:57:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:23.249324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8919c3-8fa0-4ac8-892e-af9a410ff045 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:23.339499 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:23.359081 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8919c3-8fa0-4ac8-892e-af9a410ff045 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:23.397519 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbd768-5c1e-43cb-8b9c-8dc8936870c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:23.398182 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbd768-5c1e-43cb-8b9c-8dc8936870c7 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:23.399146 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbd768-5c1e-43cb-8b9c-8dc8936870c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:23.399437 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbd768-5c1e-43cb-8b9c-8dc8936870c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:23.470470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbd768-5c1e-43cb-8b9c-8dc8936870c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:23.472016 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbd768-5c1e-43cb-8b9c-8dc8936870c7 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:23.559539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:23.577187 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 326/648] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 18:57:23.584208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcb92d-f300-40f3-b68f-70bea91bcb50 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:23.686961 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:23.714707 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcb92d-f300-40f3-b68f-70bea91bcb50 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:23.753079 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627d403-d863-4de5-8b2d-a25b6c82d386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:23.753885 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d403-d863-4de5-8b2d-a25b6c82d386 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:23.754172 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d403-d863-4de5-8b2d-a25b6c82d386 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:23.754448 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d403-d863-4de5-8b2d-a25b6c82d386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:23.765839 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627d403-d863-4de5-8b2d-a25b6c82d386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:23.767339 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627d403-d863-4de5-8b2d-a25b6c82d386 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-5627d403-d863-4de5-8b2d-a25b6c82d386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:23.786190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:23.787163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:23.788088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:23.788088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:23.788088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:23.788088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:23.788088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 323/649] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:23.793190 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbd768-5c1e-43cb-8b9c-8dc8936870c7 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:23.807962 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649e73-ff37-4046-a18f-85151baf50bb None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:23.808551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649e73-ff37-4046-a18f-85151baf50bb None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:23.809050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649e73-ff37-4046-a18f-85151baf50bb None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:23.810634 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 324/650] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:23.816103 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786d78d-f9f6-4b28-860d-1215cb8fd76c None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:23.816638 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786d78d-f9f6-4b28-860d-1215cb8fd76c None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:23.817413 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786d78d-f9f6-4b28-860d-1215cb8fd76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:23.841619 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-3786d78d-f9f6-4b28-860d-1215cb8fd76c None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:23.843701 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-3786d78d-f9f6-4b28-860d-1215cb8fd76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:23.908313 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbd768-5c1e-43cb-8b9c-8dc8936870c7 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:23.923457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 325/651] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:23.942585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786d78d-f9f6-4b28-860d-1215cb8fd76c None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:23.946653 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eb1d1-71ac-45e5-b498-a0b89b703aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:23.947612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eb1d1-71ac-45e5-b498-a0b89b703aef None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:23.948106 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eb1d1-71ac-45e5-b498-a0b89b703aef None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:23.948613 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eb1d1-71ac-45e5-b498-a0b89b703aef None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:23.949565 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eb1d1-71ac-45e5-b498-a0b89b703aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:23.950078 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eb1d1-71ac-45e5-b498-a0b89b703aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:23.951793 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eb1d1-71ac-45e5-b498-a0b89b703aef None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:23.966714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 327/652] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:23.972223 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eb1d1-71ac-45e5-b498-a0b89b703aef None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:24.020209 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:24.029338 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:24.074672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786d78d-f9f6-4b28-860d-1215cb8fd76c None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:24.082358 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eb1d1-71ac-45e5-b498-a0b89b703aef None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:24.114200 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f36b3-94d9-4313-9af0-b12c5f9e22c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:24.115273 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f36b3-94d9-4313-9af0-b12c5f9e22c9 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.115561 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f36b3-94d9-4313-9af0-b12c5f9e22c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.115836 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f36b3-94d9-4313-9af0-b12c5f9e22c9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.116487 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f36b3-94d9-4313-9af0-b12c5f9e22c9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:24.118842 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f36b3-94d9-4313-9af0-b12c5f9e22c9 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:24.120536 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33bd1f-4632-4f13-9cd0-bcf2ad8f0a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:24.121557 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33bd1f-4632-4f13-9cd0-bcf2ad8f0a37 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.122076 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33bd1f-4632-4f13-9cd0-bcf2ad8f0a37 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.122574 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33bd1f-4632-4f13-9cd0-bcf2ad8f0a37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.131522 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33bd1f-4632-4f13-9cd0-bcf2ad8f0a37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:24.134410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33bd1f-4632-4f13-9cd0-bcf2ad8f0a37 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-5a0f36b3-94d9-4313-9af0-b12c5f9e22c9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:24.135165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:24.136094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 18:57:24.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:24.141439 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 326/653] 10.222.0.98 () {56 vars in 1129 bytes} [Mon Jul 25 18:57:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:24.142419 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f36b3-94d9-4313-9af0-b12c5f9e22c9 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-bd33bd1f-4632-4f13-9cd0-bcf2ad8f0a37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:24.155309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:24.156251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:24.157151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:24.157151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:24.157151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:24.157151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:24.157151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:24.157151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:24.157151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:24.157151 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:24.159726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 328/654] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:24.165998 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33bd1f-4632-4f13-9cd0-bcf2ad8f0a37 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:24.268009 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f36b3-94d9-4313-9af0-b12c5f9e22c9 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:24.282894 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33bd1f-4632-4f13-9cd0-bcf2ad8f0a37 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:24.284906 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:24.300310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:24.311574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726982a-66c2-4be3-ac47-f23eb419eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:24.312713 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726982a-66c2-4be3-ac47-f23eb419eb53 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.313091 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726982a-66c2-4be3-ac47-f23eb419eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.313464 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726982a-66c2-4be3-ac47-f23eb419eb53 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.314376 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726982a-66c2-4be3-ac47-f23eb419eb53 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:24.315110 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726982a-66c2-4be3-ac47-f23eb419eb53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:24.316400 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726982a-66c2-4be3-ac47-f23eb419eb53 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:24.326960 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fb5d5-15d6-4666-99a7-ff1f9300d7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:24.327178 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 327/655] 10.222.0.98 () {56 vars in 1124 bytes} [Mon Jul 25 18:57:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:24.327977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fb5d5-15d6-4666-99a7-ff1f9300d7df None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.328189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726982a-66c2-4be3-ac47-f23eb419eb53 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:24.328583 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fb5d5-15d6-4666-99a7-ff1f9300d7df None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.329085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fb5d5-15d6-4666-99a7-ff1f9300d7df None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.330060 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fb5d5-15d6-4666-99a7-ff1f9300d7df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:24.330572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fb5d5-15d6-4666-99a7-ff1f9300d7df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:24.332453 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fb5d5-15d6-4666-99a7-ff1f9300d7df None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:24.345952 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 329/656] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:24.352326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fb5d5-15d6-4666-99a7-ff1f9300d7df None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:24.446781 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726982a-66c2-4be3-ac47-f23eb419eb53 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:24.473984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fb5d5-15d6-4666-99a7-ff1f9300d7df None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:24.483553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5778-bf59-4237-9d56-fa81ba6a8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:24.484227 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5778-bf59-4237-9d56-fa81ba6a8923 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.484515 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5778-bf59-4237-9d56-fa81ba6a8923 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.484807 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5778-bf59-4237-9d56-fa81ba6a8923 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.485506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d5778-bf59-4237-9d56-fa81ba6a8923 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:24.485819 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d5778-bf59-4237-9d56-fa81ba6a8923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:24.487223 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d5778-bf59-4237-9d56-fa81ba6a8923 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:24.494347 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 328/657] 10.222.0.98 () {56 vars in 1124 bytes} [Mon Jul 25 18:57:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:24.495719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d710e-6618-4760-9070-c5c58df3af05 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.496017 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d710e-6618-4760-9070-c5c58df3af05 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.496302 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d710e-6618-4760-9070-c5c58df3af05 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.497739 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 329/658] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:24.503466 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e75e2-53bf-4b5c-b434-34974c2cde46 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.503787 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e75e2-53bf-4b5c-b434-34974c2cde46 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.504036 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e75e2-53bf-4b5c-b434-34974c2cde46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.524334 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612c432-10af-40f1-890e-6eb55b917c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:24.525391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612c432-10af-40f1-890e-6eb55b917c69 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.525878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612c432-10af-40f1-890e-6eb55b917c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.526361 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612c432-10af-40f1-890e-6eb55b917c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.527587 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612c432-10af-40f1-890e-6eb55b917c69 None admin] RBAC: Adding query filter params (role.id=472a286d91bd484a83e2de07fc231c06, scope.project.id=55faf272643648349c655751011854b8, user.id=6aa237d6badd493a9f2a75bf4086fec3) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:24.527734 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-174e75e2-53bf-4b5c-b434-34974c2cde46 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:24.528252 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612c432-10af-40f1-890e-6eb55b917c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:24.529024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-174e75e2-53bf-4b5c-b434-34974c2cde46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:24.530163 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612c432-10af-40f1-890e-6eb55b917c69 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:24.537618 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 330/659] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:57:24 2022] GET /identity/v3/role_assignments?user.id=6aa237d6badd493a9f2a75bf4086fec3&scope.project.id=55faf272643648349c655751011854b8&role.id=472a286d91bd484a83e2de07fc231c06 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:24.589861 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:24.609845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 330/660] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:57:24.635323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612c432-10af-40f1-890e-6eb55b917c69 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:24.671830 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:24.761143 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612c432-10af-40f1-890e-6eb55b917c69 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:24.796245 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20888a-4dac-444d-89c4-bacf05fbf1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:24.797157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20888a-4dac-444d-89c4-bacf05fbf1d8 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.797431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20888a-4dac-444d-89c4-bacf05fbf1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.797708 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20888a-4dac-444d-89c4-bacf05fbf1d8 None admin] PATH_INFO: `/v3/services/image` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.798365 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20888a-4dac-444d-89c4-bacf05fbf1d8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:24.799767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20888a-4dac-444d-89c4-bacf05fbf1d8 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-ad20888a-4dac-444d-89c4-bacf05fbf1d8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:24.814533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:24.815576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:24.816387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 331/661] 10.222.0.98 () {56 vars in 1105 bytes} [Mon Jul 25 18:57:24 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:24.821972 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e75e2-53bf-4b5c-b434-34974c2cde46 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:24.845224 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481645d8-8971-41c7-8560-8a6f91498609 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.845511 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481645d8-8971-41c7-8560-8a6f91498609 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.845794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481645d8-8971-41c7-8560-8a6f91498609 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.848260 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 332/662] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:24.854256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e340468-981a-441f-a0cb-f7e06a509cb9 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.854599 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e340468-981a-441f-a0cb-f7e06a509cb9 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.854894 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e340468-981a-441f-a0cb-f7e06a509cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.876795 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-8e340468-981a-441f-a0cb-f7e06a509cb9 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:24.878291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-8e340468-981a-441f-a0cb-f7e06a509cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:24.936839 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e75e2-53bf-4b5c-b434-34974c2cde46 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:24.974892 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336d681-6323-4022-9f36-79f9709b4c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:24.975603 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336d681-6323-4022-9f36-79f9709b4c94 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:24.975713 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 333/663] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:57:24.979519 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336d681-6323-4022-9f36-79f9709b4c94 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:24.979811 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336d681-6323-4022-9f36-79f9709b4c94 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:24.980541 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336d681-6323-4022-9f36-79f9709b4c94 None admin] RBAC: Adding query filter params (name=image) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:24.980856 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336d681-6323-4022-9f36-79f9709b4c94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:24.982252 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336d681-6323-4022-9f36-79f9709b4c94 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:24.987340 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 331/664] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:24.993554 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e340468-981a-441f-a0cb-f7e06a509cb9 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:25.002837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336d681-6323-4022-9f36-79f9709b4c94 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:25.024901 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:25.059087 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:25.118642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336d681-6323-4022-9f36-79f9709b4c94 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:25.134977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e340468-981a-441f-a0cb-f7e06a509cb9 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:25.158037 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a54dc-4c97-4b00-8a6f-45e0a3b5e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:25.159035 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a54dc-4c97-4b00-8a6f-45e0a3b5e735 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:25.159455 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a54dc-4c97-4b00-8a6f-45e0a3b5e735 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:25.159837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a54dc-4c97-4b00-8a6f-45e0a3b5e735 None admin] PATH_INFO: `/v3/services/network` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:25.160671 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a54dc-4c97-4b00-8a6f-45e0a3b5e735 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:25.162153 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a54dc-4c97-4b00-8a6f-45e0a3b5e735 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:25.175789 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5530ca6-04d8-4a7b-812e-c5c598451ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:25.176462 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5530ca6-04d8-4a7b-812e-c5c598451ce6 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:25.176752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5530ca6-04d8-4a7b-812e-c5c598451ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:25.177029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5530ca6-04d8-4a7b-812e-c5c598451ce6 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:25.177737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5530ca6-04d8-4a7b-812e-c5c598451ce6 None admin] RBAC: Adding query filter params (type=image) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:25.178105 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5530ca6-04d8-4a7b-812e-c5c598451ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-581a54dc-4c97-4b00-8a6f-45e0a3b5e735 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:25.178371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:25.180663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 18:57:25.182211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:25.183111 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5530ca6-04d8-4a7b-812e-c5c598451ce6 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:25.183262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 332/665] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:25 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:25.188120 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a54dc-4c97-4b00-8a6f-45e0a3b5e735 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:25.195459 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 334/666] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:25.304971 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a54dc-4c97-4b00-8a6f-45e0a3b5e735 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:25.321181 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:25.344883 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f5c1f-3c63-46c4-982b-6691f5abf8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:25.345611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5c1f-3c63-46c4-982b-6691f5abf8af None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:25.346413 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5c1f-3c63-46c4-982b-6691f5abf8af None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:25.346740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5c1f-3c63-46c4-982b-6691f5abf8af None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:25.347502 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f5c1f-3c63-46c4-982b-6691f5abf8af None admin] RBAC: Adding query filter params (name=network) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:25.347873 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f5c1f-3c63-46c4-982b-6691f5abf8af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:25.349322 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f5c1f-3c63-46c4-982b-6691f5abf8af None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:25.359257 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 333/667] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:25.361518 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5530ca6-04d8-4a7b-812e-c5c598451ce6 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:25.453102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:25.471200 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5530ca6-04d8-4a7b-812e-c5c598451ce6 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:25.511449 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69c27e-cba1-4e81-a04f-35dee82f50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:25.512116 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69c27e-cba1-4e81-a04f-35dee82f50e1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:25.512404 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69c27e-cba1-4e81-a04f-35dee82f50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:25.512688 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69c27e-cba1-4e81-a04f-35dee82f50e1 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:25.513446 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69c27e-cba1-4e81-a04f-35dee82f50e1 None admin] RBAC: Adding query filter params (type=network) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:25.513762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69c27e-cba1-4e81-a04f-35dee82f50e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:25.515177 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69c27e-cba1-4e81-a04f-35dee82f50e1 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:25.520318 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 335/668] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:27.050410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92c301-fc0b-4194-aee9-17eaa9f82530 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.050933 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92c301-fc0b-4194-aee9-17eaa9f82530 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.051042 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92c301-fc0b-4194-aee9-17eaa9f82530 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.052583 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 334/669] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:27.054028 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f516bf-bf12-46bd-8c4c-26209f1cb5e6 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.054466 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f516bf-bf12-46bd-8c4c-26209f1cb5e6 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.055188 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f516bf-bf12-46bd-8c4c-26209f1cb5e6 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.056838 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 336/670] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:27.063168 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2bdee-e092-4eb0-8655-90eaca78e3fa None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.063168 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2bdee-e092-4eb0-8655-90eaca78e3fa None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.063168 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2bdee-e092-4eb0-8655-90eaca78e3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.063448 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bd3ca-b280-4ca5-a446-8db73f158fb4 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.063448 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bd3ca-b280-4ca5-a446-8db73f158fb4 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.063448 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bd3ca-b280-4ca5-a446-8db73f158fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.081153 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-821bd3ca-b280-4ca5-a446-8db73f158fb4 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:27.081925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-fcc2bdee-e092-4eb0-8655-90eaca78e3fa None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:27.082354 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-821bd3ca-b280-4ca5-a446-8db73f158fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:27.083611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-fcc2bdee-e092-4eb0-8655-90eaca78e3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:27.171171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 335/671] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:27.176976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 337/672] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:27.188904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2bdee-e092-4eb0-8655-90eaca78e3fa None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:27.203826 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bd3ca-b280-4ca5-a446-8db73f158fb4 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:27.286602 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:27.316157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bd3ca-b280-4ca5-a446-8db73f158fb4 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:27.320853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2bdee-e092-4eb0-8655-90eaca78e3fa None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:27.332036 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:27.361133 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6594-848d-4522-8cac-61c301fd71bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:27.362489 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6594-848d-4522-8cac-61c301fd71bf None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.363001 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6594-848d-4522-8cac-61c301fd71bf None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.363333 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a542b74-090c-4b48-91d5-821cc2d7ee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:27.363756 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6594-848d-4522-8cac-61c301fd71bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.364064 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a542b74-090c-4b48-91d5-821cc2d7ee2a None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.364351 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a542b74-090c-4b48-91d5-821cc2d7ee2a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.364631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a542b74-090c-4b48-91d5-821cc2d7ee2a None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.365346 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a542b74-090c-4b48-91d5-821cc2d7ee2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:27.366745 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a542b74-090c-4b48-91d5-821cc2d7ee2a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:27.382357 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d6594-848d-4522-8cac-61c301fd71bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:27.399160 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 338/673] 10.222.0.98 () {60 vars in 1141 bytes} [Mon Jul 25 18:57:27 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-534d6594-848d-4522-8cac-61c301fd71bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:27.399378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:27.400310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:57:27.401195 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:27.402454 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 336/674] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:57:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:27.403661 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a542b74-090c-4b48-91d5-821cc2d7ee2a None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:27.537414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a542b74-090c-4b48-91d5-821cc2d7ee2a None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:27.575606 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978524-149a-4d34-934b-163d60e05e8c None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.575928 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978524-149a-4d34-934b-163d60e05e8c None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.576202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978524-149a-4d34-934b-163d60e05e8c None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.577670 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47dff-b47f-40a4-824f-faf13a6eacc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:27.578051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 337/675] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:27.578408 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47dff-b47f-40a4-824f-faf13a6eacc6 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.578732 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47dff-b47f-40a4-824f-faf13a6eacc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.579056 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47dff-b47f-40a4-824f-faf13a6eacc6 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.579910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b47dff-b47f-40a4-824f-faf13a6eacc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:27.580223 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b47dff-b47f-40a4-824f-faf13a6eacc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:27.581616 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b47dff-b47f-40a4-824f-faf13a6eacc6 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:27.583288 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:27.583439 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb426517-73ed-452f-9d8c-c02b180e70dc None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.583706 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb426517-73ed-452f-9d8c-c02b180e70dc None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.583990 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb426517-73ed-452f-9d8c-c02b180e70dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.592028 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 339/676] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:57:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:27.597808 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47dff-b47f-40a4-824f-faf13a6eacc6 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:27.608180 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-eb426517-73ed-452f-9d8c-c02b180e70dc None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:27.609218 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-eb426517-73ed-452f-9d8c-c02b180e70dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:27.705867 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 338/677] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 18:57:27.730410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb426517-73ed-452f-9d8c-c02b180e70dc None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:27.734898 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47dff-b47f-40a4-824f-faf13a6eacc6 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:27.781932 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b37e63-5aa5-498c-8ae5-9c38240b10d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:27.783024 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b37e63-5aa5-498c-8ae5-9c38240b10d3 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.783488 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b37e63-5aa5-498c-8ae5-9c38240b10d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.783940 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b37e63-5aa5-498c-8ae5-9c38240b10d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.797145 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b37e63-5aa5-498c-8ae5-9c38240b10d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:27.798845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b37e63-5aa5-498c-8ae5-9c38240b10d3 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-b3b37e63-5aa5-498c-8ae5-9c38240b10d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:27.818350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:27.819493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:27.821035 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:27.821035 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:27.821035 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:27.821035 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:27.821035 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 340/678] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:27.829765 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b37e63-5aa5-498c-8ae5-9c38240b10d3 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:27.858119 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:27.864416 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb426517-73ed-452f-9d8c-c02b180e70dc None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:27.890265 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:27.908313 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a98ad5-c1f1-428b-9a47-8f2cf7ecb26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:27.909092 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a98ad5-c1f1-428b-9a47-8f2cf7ecb26e None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.909379 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a98ad5-c1f1-428b-9a47-8f2cf7ecb26e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.909656 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a98ad5-c1f1-428b-9a47-8f2cf7ecb26e None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.910373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a98ad5-c1f1-428b-9a47-8f2cf7ecb26e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:27.911804 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a98ad5-c1f1-428b-9a47-8f2cf7ecb26e None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:27.932438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 339/679] 10.222.0.98 () {60 vars in 1141 bytes} [Mon Jul 25 18:57:27 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 18:57:27.933759 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfa9ee-3375-47c8-a3bb-42a0229a9c90 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.934111 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfa9ee-3375-47c8-a3bb-42a0229a9c90 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.934402 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfa9ee-3375-47c8-a3bb-42a0229a9c90 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.935903 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 340/680] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:27.945982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f49f35-1869-4c0e-bcf6-90608743c7ef None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:27.946425 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f49f35-1869-4c0e-bcf6-90608743c7ef None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:27.946812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f49f35-1869-4c0e-bcf6-90608743c7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:27.958206 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b37e63-5aa5-498c-8ae5-9c38240b10d3 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:27.971521 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-06f49f35-1869-4c0e-bcf6-90608743c7ef None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:27.972761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-06f49f35-1869-4c0e-bcf6-90608743c7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:28.011098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7ef5a-0c63-4129-823c-a571780a8c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:28.012213 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7ef5a-0c63-4129-823c-a571780a8c89 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:28.012727 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7ef5a-0c63-4129-823c-a571780a8c89 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:28.013545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7ef5a-0c63-4129-823c-a571780a8c89 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:28.014778 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7ef5a-0c63-4129-823c-a571780a8c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:28.015229 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7ef5a-0c63-4129-823c-a571780a8c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:28.016951 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7ef5a-0c63-4129-823c-a571780a8c89 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:28.035177 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 341/681] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:28.040748 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7ef5a-0c63-4129-823c-a571780a8c89 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:28.083398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 341/682] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:27 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 18:57:28.105750 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f49f35-1869-4c0e-bcf6-90608743c7ef None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:28.173980 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7ef5a-0c63-4129-823c-a571780a8c89 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:28.176684 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:28.217693 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e6dad-9e00-4b19-9651-07df8a13e7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:28.218771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:28.219179 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e6dad-9e00-4b19-9651-07df8a13e7af None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:28.219475 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e6dad-9e00-4b19-9651-07df8a13e7af None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:28.219753 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e6dad-9e00-4b19-9651-07df8a13e7af None admin] PATH_INFO: `/v3/users/nova` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:28.230436 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e6dad-9e00-4b19-9651-07df8a13e7af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:28.231922 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e6dad-9e00-4b19-9651-07df8a13e7af None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:28.238034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f49f35-1869-4c0e-bcf6-90608743c7ef None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-177e6dad-9e00-4b19-9651-07df8a13e7af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:28.247976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:28.249067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:28.250018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:28.250018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:28.250018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:28.250018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:28.250018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:28.250018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:28.250018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:28.250018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:28.250018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:28.250018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:28.250554 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 342/683] 10.222.0.98 () {56 vars in 1093 bytes} [Mon Jul 25 18:57:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:28.255255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e6dad-9e00-4b19-9651-07df8a13e7af None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:28.284825 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda6abb-3d03-4bf1-ace3-dc362ac367a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:28.285886 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda6abb-3d03-4bf1-ace3-dc362ac367a6 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:28.286325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda6abb-3d03-4bf1-ace3-dc362ac367a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:28.286883 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda6abb-3d03-4bf1-ace3-dc362ac367a6 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:28.288629 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda6abb-3d03-4bf1-ace3-dc362ac367a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:28.290495 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda6abb-3d03-4bf1-ace3-dc362ac367a6 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:28.314435 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 342/684] 10.222.0.98 () {60 vars in 1141 bytes} [Mon Jul 25 18:57:28 2022] POST /identity/v3/services => generated 240 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 18:57:28.387675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e6dad-9e00-4b19-9651-07df8a13e7af None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:28.435798 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b1233-d175-4852-a08a-842369b50bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:28.436540 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b1233-d175-4852-a08a-842369b50bfa None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:28.436829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b1233-d175-4852-a08a-842369b50bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:28.437105 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b1233-d175-4852-a08a-842369b50bfa None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:28.438010 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b1233-d175-4852-a08a-842369b50bfa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:28.438329 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b1233-d175-4852-a08a-842369b50bfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:28.439882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b1233-d175-4852-a08a-842369b50bfa None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:28.460183 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 343/685] 10.222.0.98 () {56 vars in 1133 bytes} [Mon Jul 25 18:57:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:28.466210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda6abb-3d03-4bf1-ace3-dc362ac367a6 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:28.591038 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda6abb-3d03-4bf1-ace3-dc362ac367a6 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:28.627982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c92db2-491e-40a8-81c3-fff5ba69941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:28.629133 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92db2-491e-40a8-81c3-fff5ba69941a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:28.629626 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92db2-491e-40a8-81c3-fff5ba69941a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:28.630137 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92db2-491e-40a8-81c3-fff5ba69941a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:28.642550 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c92db2-491e-40a8-81c3-fff5ba69941a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:28.644353 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c92db2-491e-40a8-81c3-fff5ba69941a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:28.653633 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-c6c92db2-491e-40a8-81c3-fff5ba69941a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:28.664744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:28.665841 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:28.666729 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:28.666729 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:28.666729 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:28.666729 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:28.668976 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 343/686] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:28.674718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b1233-d175-4852-a08a-842369b50bfa None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:28.699551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:28.787750 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b1233-d175-4852-a08a-842369b50bfa None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:28.824100 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a2371-38cd-4a38-8466-f6381063e072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:28.824779 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a2371-38cd-4a38-8466-f6381063e072 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:28.825067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a2371-38cd-4a38-8466-f6381063e072 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:28.825351 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a2371-38cd-4a38-8466-f6381063e072 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:28.826074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a2371-38cd-4a38-8466-f6381063e072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:28.826387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a2371-38cd-4a38-8466-f6381063e072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:28.827947 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a2371-38cd-4a38-8466-f6381063e072 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:28.840767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 344/687] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:28.848281 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c92db2-491e-40a8-81c3-fff5ba69941a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:28.959818 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c92db2-491e-40a8-81c3-fff5ba69941a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:28.998122 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f50887-855d-477f-b516-74ab1eb0444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:28.998919 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f50887-855d-477f-b516-74ab1eb0444b None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:28.999228 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f50887-855d-477f-b516-74ab1eb0444b None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:28.999501 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f50887-855d-477f-b516-74ab1eb0444b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:29.006524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f50887-855d-477f-b516-74ab1eb0444b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:29.008918 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f50887-855d-477f-b516-74ab1eb0444b None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-40f50887-855d-477f-b516-74ab1eb0444b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:29.026771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:29.027736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:29.028616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:29.028616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:29.028616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:29.028616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:29.028616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:29.028616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:29.028616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:29.028616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:29.028616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 344/688] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:29.034787 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a2371-38cd-4a38-8466-f6381063e072 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:29.127616 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:29.144928 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a2371-38cd-4a38-8466-f6381063e072 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:29.181453 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde719c0-0ce3-4642-99e1-3f94da91a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:29.182102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde719c0-0ce3-4642-99e1-3f94da91a4df None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:29.182393 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde719c0-0ce3-4642-99e1-3f94da91a4df None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:29.182669 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde719c0-0ce3-4642-99e1-3f94da91a4df None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:29.183493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde719c0-0ce3-4642-99e1-3f94da91a4df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:29.183806 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde719c0-0ce3-4642-99e1-3f94da91a4df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:29.185244 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde719c0-0ce3-4642-99e1-3f94da91a4df None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:29.199938 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 345/689] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:29.205795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f50887-855d-477f-b516-74ab1eb0444b None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:29.274084 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:29.317724 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f50887-855d-477f-b516-74ab1eb0444b None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:29.353309 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f05fb-b0a6-4cf7-ab3d-01ea5ec25e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:29.354212 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f05fb-b0a6-4cf7-ab3d-01ea5ec25e69 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:29.354496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f05fb-b0a6-4cf7-ab3d-01ea5ec25e69 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:29.354772 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f05fb-b0a6-4cf7-ab3d-01ea5ec25e69 None admin] PATH_INFO: `/v3/projects/55faf272643648349c655751011854b8/users/6aa237d6badd493a9f2a75bf4086fec3/roles/472a286d91bd484a83e2de07fc231c06` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:29.356790 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f05fb-b0a6-4cf7-ab3d-01ea5ec25e69 None admin] RBAC: Authorizing `identity:create_grant(project_id=55faf272643648349c655751011854b8, user_id=6aa237d6badd493a9f2a75bf4086fec3, role_id=472a286d91bd484a83e2de07fc231c06)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:29.358237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f05fb-b0a6-4cf7-ab3d-01ea5ec25e69 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:29.372959 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 345/690] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:57:29 2022] PUT /identity/v3/projects/55faf272643648349c655751011854b8/users/6aa237d6badd493a9f2a75bf4086fec3/roles/472a286d91bd484a83e2de07fc231c06 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:57:29.839815 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0fd8f-ce27-4c93-9649-d28612546a79 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:29.840102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0fd8f-ce27-4c93-9649-d28612546a79 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:29.840658 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0fd8f-ce27-4c93-9649-d28612546a79 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:29.842503 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 346/691] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:29.847931 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592a13a-7d7b-4442-a58a-4241ae1f7f43 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:29.848458 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592a13a-7d7b-4442-a58a-4241ae1f7f43 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:29.848943 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592a13a-7d7b-4442-a58a-4241ae1f7f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:29.873558 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-7592a13a-7d7b-4442-a58a-4241ae1f7f43 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:29.875159 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-7592a13a-7d7b-4442-a58a-4241ae1f7f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:29.953918 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 346/692] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:29 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:29.978831 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0fd8f-ce27-4c93-9649-d28612546a79 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:30.082456 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0fd8f-ce27-4c93-9649-d28612546a79 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:30.124031 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a902d6-2655-42b0-a561-7f2c04b59b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:30.124945 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a902d6-2655-42b0-a561-7f2c04b59b19 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.125237 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a902d6-2655-42b0-a561-7f2c04b59b19 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.125521 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a902d6-2655-42b0-a561-7f2c04b59b19 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.126184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a902d6-2655-42b0-a561-7f2c04b59b19 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:30.127667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a902d6-2655-42b0-a561-7f2c04b59b19 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-00a902d6-2655-42b0-a561-7f2c04b59b19 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:30.142601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:30.143694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:30.144845 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 347/693] 10.222.0.98 () {56 vars in 1129 bytes} [Mon Jul 25 18:57:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:30.152760 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592a13a-7d7b-4442-a58a-4241ae1f7f43 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:30.204828 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:30.265222 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592a13a-7d7b-4442-a58a-4241ae1f7f43 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:30.303540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7eb96-7668-49ba-a8bd-6beef31ad806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:30.304209 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7eb96-7668-49ba-a8bd-6beef31ad806 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.304543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7eb96-7668-49ba-a8bd-6beef31ad806 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.305288 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7eb96-7668-49ba-a8bd-6beef31ad806 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.306008 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7eb96-7668-49ba-a8bd-6beef31ad806 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:30.306318 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7eb96-7668-49ba-a8bd-6beef31ad806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:30.307801 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7eb96-7668-49ba-a8bd-6beef31ad806 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:30.313117 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 347/694] 10.222.0.98 () {56 vars in 1124 bytes} [Mon Jul 25 18:57:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:30.318844 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a902d6-2655-42b0-a561-7f2c04b59b19 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:30.323121 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:30.418197 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527762f8-1994-42e1-bce8-959e85bf8c73 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.418532 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527762f8-1994-42e1-bce8-959e85bf8c73 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.418759 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527762f8-1994-42e1-bce8-959e85bf8c73 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.420341 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 348/695] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:30.428147 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ba26-45f4-4f85-90d6-e564eee40ec5 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.428433 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ba26-45f4-4f85-90d6-e564eee40ec5 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.428708 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ba26-45f4-4f85-90d6-e564eee40ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.433978 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a902d6-2655-42b0-a561-7f2c04b59b19 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:30.449850 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-cba1ba26-45f4-4f85-90d6-e564eee40ec5 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:30.451116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-cba1ba26-45f4-4f85-90d6-e564eee40ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:30.471337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83888cc6-3012-41b7-bd2a-a181568109d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:30.472329 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83888cc6-3012-41b7-bd2a-a181568109d4 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.472829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83888cc6-3012-41b7-bd2a-a181568109d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.473327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83888cc6-3012-41b7-bd2a-a181568109d4 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.474236 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83888cc6-3012-41b7-bd2a-a181568109d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:30.474751 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83888cc6-3012-41b7-bd2a-a181568109d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:30.476533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83888cc6-3012-41b7-bd2a-a181568109d4 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:30.486913 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 348/696] 10.222.0.98 () {56 vars in 1124 bytes} [Mon Jul 25 18:57:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:30.488504 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83888cc6-3012-41b7-bd2a-a181568109d4 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:30.527387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 349/697] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:57:30.547034 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1ba26-45f4-4f85-90d6-e564eee40ec5 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:30.560683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:30.603197 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83888cc6-3012-41b7-bd2a-a181568109d4 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:30.611759 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:30.643735 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb7391-4ccc-438f-a996-d77f2c6ceb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:30.644814 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb7391-4ccc-438f-a996-d77f2c6ceb36 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.645322 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb7391-4ccc-438f-a996-d77f2c6ceb36 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.646239 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb7391-4ccc-438f-a996-d77f2c6ceb36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.647642 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb7391-4ccc-438f-a996-d77f2c6ceb36 None admin] RBAC: Adding query filter params (interface=public, service_id=b5889b3e86c04b848c105261fbd63295, region_id=RegionOne) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:30.648322 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb7391-4ccc-438f-a996-d77f2c6ceb36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:30.650520 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb7391-4ccc-438f-a996-d77f2c6ceb36 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:30.658728 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1ba26-45f4-4f85-90d6-e564eee40ec5 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:30.661882 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 349/698] 10.222.0.98 () {56 vars in 1251 bytes} [Mon Jul 25 18:57:30 2022] GET /identity/v3/endpoints?service_id=b5889b3e86c04b848c105261fbd63295&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:30.667995 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb7391-4ccc-438f-a996-d77f2c6ceb36 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:30.713315 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583629c-f58c-49f8-93d4-c280a147b2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:30.714256 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583629c-f58c-49f8-93d4-c280a147b2cd None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.714440 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583629c-f58c-49f8-93d4-c280a147b2cd None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.714695 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583629c-f58c-49f8-93d4-c280a147b2cd None admin] PATH_INFO: `/v3/services/image` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.715393 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583629c-f58c-49f8-93d4-c280a147b2cd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:30.716955 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583629c-f58c-49f8-93d4-c280a147b2cd None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-3583629c-f58c-49f8-93d4-c280a147b2cd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:30.730062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:30.731116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 18:57:30.731995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:30.735417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 350/699] 10.222.0.98 () {56 vars in 1105 bytes} [Mon Jul 25 18:57:30 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:30.737439 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583629c-f58c-49f8-93d4-c280a147b2cd None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:30.799541 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb7391-4ccc-438f-a996-d77f2c6ceb36 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:30.832727 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:30.839903 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2139a-ab8e-41f8-8892-ab616fe98d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:30.840566 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2139a-ab8e-41f8-8892-ab616fe98d47 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.840849 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2139a-ab8e-41f8-8892-ab616fe98d47 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.841127 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2139a-ab8e-41f8-8892-ab616fe98d47 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.841803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2139a-ab8e-41f8-8892-ab616fe98d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:30.843205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2139a-ab8e-41f8-8892-ab616fe98d47 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:30.854742 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 350/700] 10.222.0.98 () {56 vars in 1087 bytes} [Mon Jul 25 18:57:30 2022] GET /identity/v3/services => generated 1002 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 18:57:30.863574 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ddcc6-0287-44a1-bda8-e6edd71197b5 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.863901 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ddcc6-0287-44a1-bda8-e6edd71197b5 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.864187 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ddcc6-0287-44a1-bda8-e6edd71197b5 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.870588 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 351/701] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:30.870776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583629c-f58c-49f8-93d4-c280a147b2cd None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:30.872123 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf0842-6847-43c5-b52a-9a0e187a6c88 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.872406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf0842-6847-43c5-b52a-9a0e187a6c88 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.872771 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf0842-6847-43c5-b52a-9a0e187a6c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.881922 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:30.892154 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-c2cf0842-6847-43c5-b52a-9a0e187a6c88 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:30.893377 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-c2cf0842-6847-43c5-b52a-9a0e187a6c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:30.915611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d4480-f663-4ca1-81ff-bcefe86f4c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:30.916434 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d4480-f663-4ca1-81ff-bcefe86f4c8c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:30.916723 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d4480-f663-4ca1-81ff-bcefe86f4c8c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:30.917145 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d4480-f663-4ca1-81ff-bcefe86f4c8c None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:30.917897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d4480-f663-4ca1-81ff-bcefe86f4c8c None admin] RBAC: Adding query filter params (name=image) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:30.918212 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d4480-f663-4ca1-81ff-bcefe86f4c8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:30.919658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d4480-f663-4ca1-81ff-bcefe86f4c8c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:30.925630 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 351/702] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:30.932411 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d4480-f663-4ca1-81ff-bcefe86f4c8c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:30.983547 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 352/703] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:31.005596 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf0842-6847-43c5-b52a-9a0e187a6c88 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:31.051765 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d4480-f663-4ca1-81ff-bcefe86f4c8c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:31.095289 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1456cfc-5e12-4deb-bba5-35c6420e6f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:31.096254 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1456cfc-5e12-4deb-bba5-35c6420e6f8a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:31.097285 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1456cfc-5e12-4deb-bba5-35c6420e6f8a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:31.097772 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1456cfc-5e12-4deb-bba5-35c6420e6f8a None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:31.098638 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1456cfc-5e12-4deb-bba5-35c6420e6f8a None admin] RBAC: Adding query filter params (type=image) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:31.099115 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1456cfc-5e12-4deb-bba5-35c6420e6f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:31.101531 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1456cfc-5e12-4deb-bba5-35c6420e6f8a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:31.112917 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 352/704] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:31.121378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1456cfc-5e12-4deb-bba5-35c6420e6f8a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:31.150667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf0842-6847-43c5-b52a-9a0e187a6c88 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:31.164950 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:31.184324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:31.201242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097064ef-3234-4621-a290-47fdeca52244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:31.202040 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097064ef-3234-4621-a290-47fdeca52244 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:31.202323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097064ef-3234-4621-a290-47fdeca52244 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:31.202591 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097064ef-3234-4621-a290-47fdeca52244 None admin] PATH_INFO: `/v3/services/network` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:31.203277 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097064ef-3234-4621-a290-47fdeca52244 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:31.204645 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097064ef-3234-4621-a290-47fdeca52244 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-097064ef-3234-4621-a290-47fdeca52244 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:31.218671 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:31.219736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:31.221102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 353/705] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:31 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:31.225988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097064ef-3234-4621-a290-47fdeca52244 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:31.253925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1456cfc-5e12-4deb-bba5-35c6420e6f8a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:31.299842 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a302a-b50f-49f1-a446-9e607d3cb50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:31.300814 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a302a-b50f-49f1-a446-9e607d3cb50c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:31.301206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a302a-b50f-49f1-a446-9e607d3cb50c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:31.301843 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a302a-b50f-49f1-a446-9e607d3cb50c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:31.302495 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a302a-b50f-49f1-a446-9e607d3cb50c None admin] RBAC: Adding query filter params (interface=public, service_id=e8cee5ffaab549dda72759eb706c0d37, region_id=RegionOne) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:31.302811 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a302a-b50f-49f1-a446-9e607d3cb50c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:31.304225 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a302a-b50f-49f1-a446-9e607d3cb50c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:31.314107 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 353/706] 10.222.0.98 () {56 vars in 1251 bytes} [Mon Jul 25 18:57:31 2022] GET /identity/v3/endpoints?service_id=e8cee5ffaab549dda72759eb706c0d37&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:31.321183 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a302a-b50f-49f1-a446-9e607d3cb50c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:31.355860 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097064ef-3234-4621-a290-47fdeca52244 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:31.396716 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b13cf-ca5f-4c04-9008-8e8db9c297ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:31.397907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b13cf-ca5f-4c04-9008-8e8db9c297ab None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:31.398641 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b13cf-ca5f-4c04-9008-8e8db9c297ab None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:31.399214 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b13cf-ca5f-4c04-9008-8e8db9c297ab None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:31.400025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b13cf-ca5f-4c04-9008-8e8db9c297ab None admin] RBAC: Adding query filter params (name=network) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:31.400487 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b13cf-ca5f-4c04-9008-8e8db9c297ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:31.402394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b13cf-ca5f-4c04-9008-8e8db9c297ab None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:31.412803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 354/707] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:31.414609 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b13cf-ca5f-4c04-9008-8e8db9c297ab None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:31.448334 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:31.452186 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a302a-b50f-49f1-a446-9e607d3cb50c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:31.475375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:31.491266 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b095d-ce6c-44dc-ae97-992db3f9301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:31.492744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b095d-ce6c-44dc-ae97-992db3f9301d None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:31.493185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b095d-ce6c-44dc-ae97-992db3f9301d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:31.493625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b095d-ce6c-44dc-ae97-992db3f9301d None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:31.494456 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b095d-ce6c-44dc-ae97-992db3f9301d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:31.496284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b095d-ce6c-44dc-ae97-992db3f9301d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:31.511467 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 354/708] 10.222.0.98 () {56 vars in 1087 bytes} [Mon Jul 25 18:57:31 2022] GET /identity/v3/services => generated 1002 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 18:57:31.532597 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b13cf-ca5f-4c04-9008-8e8db9c297ab None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:31.574860 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e8f1d-77d5-4e71-bf22-524dc3c808c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:31.575589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e8f1d-77d5-4e71-bf22-524dc3c808c6 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:31.576067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e8f1d-77d5-4e71-bf22-524dc3c808c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:31.576612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e8f1d-77d5-4e71-bf22-524dc3c808c6 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:31.578022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e8f1d-77d5-4e71-bf22-524dc3c808c6 None admin] RBAC: Adding query filter params (type=network) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:31.578750 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e8f1d-77d5-4e71-bf22-524dc3c808c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:31.580568 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e8f1d-77d5-4e71-bf22-524dc3c808c6 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:31.588196 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 355/709] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:31.596267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b095d-ce6c-44dc-ae97-992db3f9301d None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:31.726135 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b095d-ce6c-44dc-ae97-992db3f9301d None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:31.740501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad53d9-b274-423c-b6aa-30ac07ec96e5 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:31.740811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad53d9-b274-423c-b6aa-30ac07ec96e5 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:31.741069 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad53d9-b274-423c-b6aa-30ac07ec96e5 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:31.742802 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 356/710] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:31.748229 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787846a-77be-4833-bddf-cf5cf349681d None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:31.748525 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787846a-77be-4833-bddf-cf5cf349681d None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:31.748812 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787846a-77be-4833-bddf-cf5cf349681d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:31.770964 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-1787846a-77be-4833-bddf-cf5cf349681d None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:31.772161 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-1787846a-77be-4833-bddf-cf5cf349681d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:31.776905 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f31ad-deb5-487e-b369-b1f096a7d03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:31.777843 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f31ad-deb5-487e-b369-b1f096a7d03f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:31.778337 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f31ad-deb5-487e-b369-b1f096a7d03f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:31.778829 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f31ad-deb5-487e-b369-b1f096a7d03f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:31.779975 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f31ad-deb5-487e-b369-b1f096a7d03f None admin] RBAC: Adding query filter params (interface=public, service_id=a8bd2dc4e79b4b61aa724dd4a0bd2a9a, region_id=RegionOne) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:31.780512 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f31ad-deb5-487e-b369-b1f096a7d03f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:31.782605 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f31ad-deb5-487e-b369-b1f096a7d03f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:31.791473 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 355/711] 10.222.0.98 () {56 vars in 1251 bytes} [Mon Jul 25 18:57:31 2022] GET /identity/v3/endpoints?service_id=a8bd2dc4e79b4b61aa724dd4a0bd2a9a&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:31.796891 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f31ad-deb5-487e-b369-b1f096a7d03f None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:31.828420 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:31.871302 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 357/712] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:57:31.895707 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787846a-77be-4833-bddf-cf5cf349681d None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:31.914189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f31ad-deb5-487e-b369-b1f096a7d03f None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:31.949877 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:31.959376 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf85174-cdf7-456a-abfa-eaee227248bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:31.960048 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf85174-cdf7-456a-abfa-eaee227248bb None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:31.960328 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf85174-cdf7-456a-abfa-eaee227248bb None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:31.960628 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf85174-cdf7-456a-abfa-eaee227248bb None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:31.961851 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf85174-cdf7-456a-abfa-eaee227248bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:31.963260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf85174-cdf7-456a-abfa-eaee227248bb None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:31.970048 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 356/713] 10.222.0.98 () {56 vars in 1087 bytes} [Mon Jul 25 18:57:31 2022] GET /identity/v3/services => generated 1002 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 18:57:32.017848 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787846a-77be-4833-bddf-cf5cf349681d None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:32.059155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5afdd-aa8c-48ef-b5c0-4cabe3ad135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:32.060241 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5afdd-aa8c-48ef-b5c0-4cabe3ad135f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:32.060852 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5afdd-aa8c-48ef-b5c0-4cabe3ad135f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:32.061287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5afdd-aa8c-48ef-b5c0-4cabe3ad135f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:32.075387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5afdd-aa8c-48ef-b5c0-4cabe3ad135f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-0fd5afdd-aa8c-48ef-b5c0-4cabe3ad135f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:57:32.083834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:32.085090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:57:32.086276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:32.088867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 358/714] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:32.095210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf85174-cdf7-456a-abfa-eaee227248bb None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:32.205179 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:32.215563 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf85174-cdf7-456a-abfa-eaee227248bb None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:32.255458 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73544f0-11a3-48e2-8758-0cdf4aac28c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:32.256135 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73544f0-11a3-48e2-8758-0cdf4aac28c0 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:32.256420 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73544f0-11a3-48e2-8758-0cdf4aac28c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:32.256960 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73544f0-11a3-48e2-8758-0cdf4aac28c0 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:32.257710 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73544f0-11a3-48e2-8758-0cdf4aac28c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:32.258019 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73544f0-11a3-48e2-8758-0cdf4aac28c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:32.259436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73544f0-11a3-48e2-8758-0cdf4aac28c0 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:32.268801 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 357/715] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:57:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:32.274953 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5afdd-aa8c-48ef-b5c0-4cabe3ad135f None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:32.383080 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5afdd-aa8c-48ef-b5c0-4cabe3ad135f None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:32.391476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:32.420365 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3da80e-3bbc-4492-b001-3ec5818fca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:32.421317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3da80e-3bbc-4492-b001-3ec5818fca19 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:32.421704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3da80e-3bbc-4492-b001-3ec5818fca19 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:32.422090 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3da80e-3bbc-4492-b001-3ec5818fca19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:32.433693 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3da80e-3bbc-4492-b001-3ec5818fca19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:32.435357 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3da80e-3bbc-4492-b001-3ec5818fca19 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-6a3da80e-3bbc-4492-b001-3ec5818fca19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:32.453762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:32.454829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:32.455942 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:32.455942 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:32.455942 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:32.455942 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:32.457540 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 359/716] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:32.464216 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73544f0-11a3-48e2-8758-0cdf4aac28c0 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:32.574737 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73544f0-11a3-48e2-8758-0cdf4aac28c0 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:32.610316 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac30a4d-59e4-48b1-be09-a03fb4d7f1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:32.611274 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac30a4d-59e4-48b1-be09-a03fb4d7f1ca None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:32.611665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac30a4d-59e4-48b1-be09-a03fb4d7f1ca None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:32.612064 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac30a4d-59e4-48b1-be09-a03fb4d7f1ca None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:32.612897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac30a4d-59e4-48b1-be09-a03fb4d7f1ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:32.613310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac30a4d-59e4-48b1-be09-a03fb4d7f1ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:32.614863 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac30a4d-59e4-48b1-be09-a03fb4d7f1ca None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:32.627881 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 358/717] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:32.634269 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3da80e-3bbc-4492-b001-3ec5818fca19 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:32.743805 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3da80e-3bbc-4492-b001-3ec5818fca19 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:32.782170 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5fdc8-6b87-4aa6-81f3-00bb2990db8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:32.782980 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5fdc8-6b87-4aa6-81f3-00bb2990db8f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:32.783294 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5fdc8-6b87-4aa6-81f3-00bb2990db8f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:32.783578 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5fdc8-6b87-4aa6-81f3-00bb2990db8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:32.792237 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5fdc8-6b87-4aa6-81f3-00bb2990db8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:32.793703 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5fdc8-6b87-4aa6-81f3-00bb2990db8f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-6cd5fdc8-6b87-4aa6-81f3-00bb2990db8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:32.809057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:32.810216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:32.811390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 360/718] 10.222.0.98 () {56 vars in 1093 bytes} [Mon Jul 25 18:57:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:32.816381 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac30a4d-59e4-48b1-be09-a03fb4d7f1ca None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:32.834083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:32.934672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac30a4d-59e4-48b1-be09-a03fb4d7f1ca None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:32.969288 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c4091-1ab6-417c-92f1-7dbc42adde17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:32.969957 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c4091-1ab6-417c-92f1-7dbc42adde17 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:32.970354 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c4091-1ab6-417c-92f1-7dbc42adde17 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:32.970638 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c4091-1ab6-417c-92f1-7dbc42adde17 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:32.971503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c4091-1ab6-417c-92f1-7dbc42adde17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:32.971817 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c4091-1ab6-417c-92f1-7dbc42adde17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:32.973259 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c4091-1ab6-417c-92f1-7dbc42adde17 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:32.992160 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 359/719] 10.222.0.98 () {56 vars in 1133 bytes} [Mon Jul 25 18:57:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:32.997614 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5fdc8-6b87-4aa6-81f3-00bb2990db8f None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:33.028161 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:33.105237 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5fdc8-6b87-4aa6-81f3-00bb2990db8f None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:33.144215 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ecee3-6ff5-41c8-b522-b3624822993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:33.144964 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ecee3-6ff5-41c8-b522-b3624822993c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:33.145255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ecee3-6ff5-41c8-b522-b3624822993c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:33.145534 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ecee3-6ff5-41c8-b522-b3624822993c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:33.221717 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ecee3-6ff5-41c8-b522-b3624822993c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:33.223242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ecee3-6ff5-41c8-b522-b3624822993c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:33.247920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:33.290411 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46f756-d559-4411-99fc-2e55b3ca530f None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:33.290747 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46f756-d559-4411-99fc-2e55b3ca530f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:33.290983 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46f756-d559-4411-99fc-2e55b3ca530f None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:33.292850 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 360/720] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:33.297972 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e965bf-e37a-44de-838a-57854479a0d2 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:33.298370 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e965bf-e37a-44de-838a-57854479a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:33.298849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e965bf-e37a-44de-838a-57854479a0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:33.319646 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-36e965bf-e37a-44de-838a-57854479a0d2 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:33.321580 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-36e965bf-e37a-44de-838a-57854479a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:33.341074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 361/721] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:32 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 18:57:33.346910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ecee3-6ff5-41c8-b522-b3624822993c None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:33.415273 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 361/722] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:33 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:33.441868 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e965bf-e37a-44de-838a-57854479a0d2 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:33.444446 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:33.468650 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ecee3-6ff5-41c8-b522-b3624822993c None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:33.491488 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:33.508923 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e1b10-4a0d-4013-b85e-6ba0189a6192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:33.511287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e1b10-4a0d-4013-b85e-6ba0189a6192 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:33.511287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e1b10-4a0d-4013-b85e-6ba0189a6192 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:33.511287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e1b10-4a0d-4013-b85e-6ba0189a6192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:33.521744 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e1b10-4a0d-4013-b85e-6ba0189a6192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:33.524013 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e1b10-4a0d-4013-b85e-6ba0189a6192 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-9c8e1b10-4a0d-4013-b85e-6ba0189a6192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:33.543794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:33.544719 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:33.545622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:33.545622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:33.545622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:33.545622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:33.545622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 362/723] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:33.550531 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e965bf-e37a-44de-838a-57854479a0d2 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:33.552016 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e1b10-4a0d-4013-b85e-6ba0189a6192 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:33.589845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5939e10-fdab-4471-b05c-6388aa65d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:33.590710 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939e10-fdab-4471-b05c-6388aa65d6de None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:33.591017 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939e10-fdab-4471-b05c-6388aa65d6de None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:33.591331 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939e10-fdab-4471-b05c-6388aa65d6de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:33.591967 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5939e10-fdab-4471-b05c-6388aa65d6de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:33.593424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5939e10-fdab-4471-b05c-6388aa65d6de None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-b5939e10-fdab-4471-b05c-6388aa65d6de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:33.609205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:33.610237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:33.611109 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 362/724] 10.222.0.98 () {56 vars in 1129 bytes} [Mon Jul 25 18:57:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:33.627276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5939e10-fdab-4471-b05c-6388aa65d6de None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:33.672731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e1b10-4a0d-4013-b85e-6ba0189a6192 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:33.711493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa93e8a-adff-4569-a0d1-76f9d8aad303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:33.712170 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa93e8a-adff-4569-a0d1-76f9d8aad303 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:33.712459 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa93e8a-adff-4569-a0d1-76f9d8aad303 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:33.712824 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa93e8a-adff-4569-a0d1-76f9d8aad303 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:33.714080 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa93e8a-adff-4569-a0d1-76f9d8aad303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:33.714534 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa93e8a-adff-4569-a0d1-76f9d8aad303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:33.715951 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa93e8a-adff-4569-a0d1-76f9d8aad303 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:33.717869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:33.735590 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 363/725] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:33.744463 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa93e8a-adff-4569-a0d1-76f9d8aad303 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:33.769538 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5939e10-fdab-4471-b05c-6388aa65d6de None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:33.779236 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:33.813889 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6cc99-742d-43e3-9f51-67e45378edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:33.814970 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6cc99-742d-43e3-9f51-67e45378edd0 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:33.815503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6cc99-742d-43e3-9f51-67e45378edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:33.816051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6cc99-742d-43e3-9f51-67e45378edd0 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:33.817007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6cc99-742d-43e3-9f51-67e45378edd0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:33.817516 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6cc99-742d-43e3-9f51-67e45378edd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:33.819114 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6cc99-742d-43e3-9f51-67e45378edd0 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:33.829816 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 363/726] 10.222.0.98 () {56 vars in 1124 bytes} [Mon Jul 25 18:57:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:33.830557 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6cc99-742d-43e3-9f51-67e45378edd0 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:33.872796 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa93e8a-adff-4569-a0d1-76f9d8aad303 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:33.925346 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace9db9-76cd-40c2-9ab8-951408761fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:33.927250 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace9db9-76cd-40c2-9ab8-951408761fa9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:33.927912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace9db9-76cd-40c2-9ab8-951408761fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:33.928504 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace9db9-76cd-40c2-9ab8-951408761fa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:33.939199 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace9db9-76cd-40c2-9ab8-951408761fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:33.941583 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace9db9-76cd-40c2-9ab8-951408761fa9 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:33.950175 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6cc99-742d-43e3-9f51-67e45378edd0 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-0ace9db9-76cd-40c2-9ab8-951408761fa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:33.970902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:33.973055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:33.974775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:33.974775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:33.974775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:33.974775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:33.974775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:33.974775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:33.974775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:33.974775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:33.983387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 364/727] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:33.983387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92aa02-1dbd-46b3-9aaa-c6637e388f37 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:33.983387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92aa02-1dbd-46b3-9aaa-c6637e388f37 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:33.983387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92aa02-1dbd-46b3-9aaa-c6637e388f37 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:33.983387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 365/728] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:33.984351 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92aa02-1dbd-46b3-9aaa-c6637e388f37 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:34.001900 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:34.009041 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a1c2d-9162-4366-a278-f7bd9e72a4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:34.009732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a1c2d-9162-4366-a278-f7bd9e72a4c5 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.010022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a1c2d-9162-4366-a278-f7bd9e72a4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.010301 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a1c2d-9162-4366-a278-f7bd9e72a4c5 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.011011 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a1c2d-9162-4366-a278-f7bd9e72a4c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:34.011384 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a1c2d-9162-4366-a278-f7bd9e72a4c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:34.012769 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a1c2d-9162-4366-a278-f7bd9e72a4c5 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:34.018057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 364/729] 10.222.0.98 () {56 vars in 1124 bytes} [Mon Jul 25 18:57:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:34.020513 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b786-ae4a-4734-a7a5-88215774ee41 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.020802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b786-ae4a-4734-a7a5-88215774ee41 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.021079 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b786-ae4a-4734-a7a5-88215774ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.042309 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-7bf3b786-ae4a-4734-a7a5-88215774ee41 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:34.043587 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-7bf3b786-ae4a-4734-a7a5-88215774ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:34.090375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:34.102924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92aa02-1dbd-46b3-9aaa-c6637e388f37 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:34.120698 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 365/730] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:34.121524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3b786-ae4a-4734-a7a5-88215774ee41 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:34.156074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87df2f9-bf8e-43ae-b9f5-926b15455975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:34.156744 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df2f9-bf8e-43ae-b9f5-926b15455975 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.157026 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df2f9-bf8e-43ae-b9f5-926b15455975 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.157298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df2f9-bf8e-43ae-b9f5-926b15455975 None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.158075 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87df2f9-bf8e-43ae-b9f5-926b15455975 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:34.158381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87df2f9-bf8e-43ae-b9f5-926b15455975 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:34.159838 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87df2f9-bf8e-43ae-b9f5-926b15455975 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:34.175248 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 366/731] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:57:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:34.176077 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87df2f9-bf8e-43ae-b9f5-926b15455975 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:34.240709 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3b786-ae4a-4734-a7a5-88215774ee41 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:34.267552 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:34.280384 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4c2aa-8bb9-47c1-9b2a-9ba01cd7742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:34.281165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c2aa-8bb9-47c1-9b2a-9ba01cd7742a None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.281503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c2aa-8bb9-47c1-9b2a-9ba01cd7742a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.281787 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c2aa-8bb9-47c1-9b2a-9ba01cd7742a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.282544 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4c2aa-8bb9-47c1-9b2a-9ba01cd7742a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:34.285622 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4c2aa-8bb9-47c1-9b2a-9ba01cd7742a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:34.286840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87df2f9-bf8e-43ae-b9f5-926b15455975 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:34.313736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 366/732] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 18:57:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:34.322029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4c2aa-8bb9-47c1-9b2a-9ba01cd7742a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:34.338923 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453839d-5914-4a4e-a8af-2b830b486da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:34.339783 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453839d-5914-4a4e-a8af-2b830b486da9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.340067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453839d-5914-4a4e-a8af-2b830b486da9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.340342 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453839d-5914-4a4e-a8af-2b830b486da9 None admin] PATH_INFO: `/v3/services/image` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.341038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453839d-5914-4a4e-a8af-2b830b486da9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:34.342664 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453839d-5914-4a4e-a8af-2b830b486da9 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-3453839d-5914-4a4e-a8af-2b830b486da9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:34.356982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:34.358124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 18:57:34.358962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:34.363511 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 367/733] 10.222.0.98 () {56 vars in 1105 bytes} [Mon Jul 25 18:57:34 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:34.364473 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453839d-5914-4a4e-a8af-2b830b486da9 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:34.380614 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:34.460232 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4c2aa-8bb9-47c1-9b2a-9ba01cd7742a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:34.485760 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453839d-5914-4a4e-a8af-2b830b486da9 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:34.501590 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ea53a-7600-474a-a375-f727993c4a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:34.502587 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea53a-7600-474a-a375-f727993c4a67 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.503030 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea53a-7600-474a-a375-f727993c4a67 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.503347 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea53a-7600-474a-a375-f727993c4a67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.504174 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ea53a-7600-474a-a375-f727993c4a67 None admin] RBAC: Adding query filter params (role.id=472a286d91bd484a83e2de07fc231c06, scope.project.id=55faf272643648349c655751011854b8, user.id=6aa237d6badd493a9f2a75bf4086fec3) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:34.504602 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ea53a-7600-474a-a375-f727993c4a67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:34.506046 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ea53a-7600-474a-a375-f727993c4a67 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:34.515968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 367/734] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:57:34 2022] GET /identity/v3/role_assignments?user.id=6aa237d6badd493a9f2a75bf4086fec3&scope.project.id=55faf272643648349c655751011854b8&role.id=472a286d91bd484a83e2de07fc231c06 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:34.515968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e104041-8a11-4665-9f7e-e89dd5853f0f None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.515968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e104041-8a11-4665-9f7e-e89dd5853f0f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.515968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e104041-8a11-4665-9f7e-e89dd5853f0f None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.515968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 368/735] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:34.522731 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21027c-8126-4058-8410-fe7181f0f594 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.524369 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21027c-8126-4058-8410-fe7181f0f594 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.524369 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21027c-8126-4058-8410-fe7181f0f594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.529994 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019b3c-a36d-4804-b4b0-5f09636d0de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:34.530829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019b3c-a36d-4804-b4b0-5f09636d0de3 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.531267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019b3c-a36d-4804-b4b0-5f09636d0de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.532616 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019b3c-a36d-4804-b4b0-5f09636d0de3 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.533463 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019b3c-a36d-4804-b4b0-5f09636d0de3 None admin] RBAC: Adding query filter params (name=image) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:34.533851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019b3c-a36d-4804-b4b0-5f09636d0de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:34.535317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019b3c-a36d-4804-b4b0-5f09636d0de3 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:34.542932 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 368/736] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:34.547575 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-0b21027c-8126-4058-8410-fe7181f0f594 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:34.549129 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-0b21027c-8126-4058-8410-fe7181f0f594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:34.549257 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019b3c-a36d-4804-b4b0-5f09636d0de3 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:34.598915 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:34.631035 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 369/737] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:34.655387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:34.663446 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21027c-8126-4058-8410-fe7181f0f594 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:34.687324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019b3c-a36d-4804-b4b0-5f09636d0de3 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:34.725971 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a794fca-380b-49c6-87b3-d332222fab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:34.726787 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a794fca-380b-49c6-87b3-d332222fab21 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.727114 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a794fca-380b-49c6-87b3-d332222fab21 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.727390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a794fca-380b-49c6-87b3-d332222fab21 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.728102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a794fca-380b-49c6-87b3-d332222fab21 None admin] RBAC: Adding query filter params (type=image) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:34.728414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a794fca-380b-49c6-87b3-d332222fab21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:34.729806 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a794fca-380b-49c6-87b3-d332222fab21 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:34.735070 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 369/738] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:34.740962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a794fca-380b-49c6-87b3-d332222fab21 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:34.791313 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21027c-8126-4058-8410-fe7181f0f594 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:34.839615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4985e30-6622-4033-a69d-7fe0771c937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:34.840577 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4985e30-6622-4033-a69d-7fe0771c937e None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.841006 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4985e30-6622-4033-a69d-7fe0771c937e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.841935 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4985e30-6622-4033-a69d-7fe0771c937e None admin] PATH_INFO: `/v3/services/network` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.842717 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4985e30-6622-4033-a69d-7fe0771c937e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:34.844825 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4985e30-6622-4033-a69d-7fe0771c937e None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-e4985e30-6622-4033-a69d-7fe0771c937e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:34.862639 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:34.864833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 18:57:34.865995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:34.867244 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 370/739] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:34 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:34.872627 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4985e30-6622-4033-a69d-7fe0771c937e None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:34.880308 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a794fca-380b-49c6-87b3-d332222fab21 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:34.924840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85b5ff-a8da-4879-9cdd-c3e36b0c278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:34.925094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:34.925511 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85b5ff-a8da-4879-9cdd-c3e36b0c278f None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:34.925801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85b5ff-a8da-4879-9cdd-c3e36b0c278f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:34.926191 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85b5ff-a8da-4879-9cdd-c3e36b0c278f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:34.926946 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85b5ff-a8da-4879-9cdd-c3e36b0c278f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:34.928459 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85b5ff-a8da-4879-9cdd-c3e36b0c278f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:34.938737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:34.957119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 370/740] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 18:57:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 18:57:35.002101 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4985e30-6622-4033-a69d-7fe0771c937e None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:35.051718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5682d-d1b1-4003-92c8-3c1c249d7b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:35.052313 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5682d-d1b1-4003-92c8-3c1c249d7b43 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:35.052645 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5682d-d1b1-4003-92c8-3c1c249d7b43 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:35.052926 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5682d-d1b1-4003-92c8-3c1c249d7b43 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:35.053651 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5682d-d1b1-4003-92c8-3c1c249d7b43 None admin] RBAC: Adding query filter params (name=network) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:35.053959 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5682d-d1b1-4003-92c8-3c1c249d7b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:35.056415 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5682d-d1b1-4003-92c8-3c1c249d7b43 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:35.062498 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 371/741] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:35.068194 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85b5ff-a8da-4879-9cdd-c3e36b0c278f None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:35.188031 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85b5ff-a8da-4879-9cdd-c3e36b0c278f None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:35.225043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76caa-c0db-45ab-ac27-7846b63dad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:35.225713 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76caa-c0db-45ab-ac27-7846b63dad0f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:35.226022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76caa-c0db-45ab-ac27-7846b63dad0f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:35.226887 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76caa-c0db-45ab-ac27-7846b63dad0f None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:35.227646 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76caa-c0db-45ab-ac27-7846b63dad0f None admin] RBAC: Adding query filter params (type=network) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:35.228017 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76caa-c0db-45ab-ac27-7846b63dad0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:35.229497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76caa-c0db-45ab-ac27-7846b63dad0f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:35.236032 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 371/742] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:35.241233 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5682d-d1b1-4003-92c8-3c1c249d7b43 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:35.351629 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:35.356051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5682d-d1b1-4003-92c8-3c1c249d7b43 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:35.396988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064647f-7971-4e57-96e9-7a270556af1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:35.398573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064647f-7971-4e57-96e9-7a270556af1b None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:35.399040 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064647f-7971-4e57-96e9-7a270556af1b None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:35.399647 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064647f-7971-4e57-96e9-7a270556af1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:35.400642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064647f-7971-4e57-96e9-7a270556af1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:35.402226 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064647f-7971-4e57-96e9-7a270556af1b None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:35.424805 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 372/743] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 18:57:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:36.734871 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3263270-3d3e-4879-a15b-53a080d6ed39 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:36.735423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3263270-3d3e-4879-a15b-53a080d6ed39 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:36.735503 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3263270-3d3e-4879-a15b-53a080d6ed39 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:36.736851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 372/744] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:36.743103 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d8a2-06da-4f47-accc-57a6915f6e0e None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:36.743549 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d8a2-06da-4f47-accc-57a6915f6e0e None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:36.743760 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d8a2-06da-4f47-accc-57a6915f6e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:36.763178 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-5ae6d8a2-06da-4f47-accc-57a6915f6e0e None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:36.764385 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-5ae6d8a2-06da-4f47-accc-57a6915f6e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:36.846965 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 373/745] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:36 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:36.870873 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3263270-3d3e-4879-a15b-53a080d6ed39 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:36.938477 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:36.972560 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1e27-c818-4179-b5a4-0b4a2c9a0d72 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:36.972855 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1e27-c818-4179-b5a4-0b4a2c9a0d72 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:36.973136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1e27-c818-4179-b5a4-0b4a2c9a0d72 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:36.974512 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 374/746] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:36.980003 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182a95b-e443-4043-a6e7-cf245fc60950 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:36.980297 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182a95b-e443-4043-a6e7-cf245fc60950 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:36.980663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182a95b-e443-4043-a6e7-cf245fc60950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:36.986377 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3263270-3d3e-4879-a15b-53a080d6ed39 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:37.001042 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-1182a95b-e443-4043-a6e7-cf245fc60950 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:37.002252 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-1182a95b-e443-4043-a6e7-cf245fc60950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:37.024198 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2af953-4aa6-48bc-b160-aa70d7c0d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:37.025003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2af953-4aa6-48bc-b160-aa70d7c0d69f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:37.025290 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2af953-4aa6-48bc-b160-aa70d7c0d69f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:37.025566 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2af953-4aa6-48bc-b160-aa70d7c0d69f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:37.026212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2af953-4aa6-48bc-b160-aa70d7c0d69f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:37.027600 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2af953-4aa6-48bc-b160-aa70d7c0d69f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-5e2af953-4aa6-48bc-b160-aa70d7c0d69f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:37.040631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:37.041822 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:37.042675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 373/747] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:57:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:37.048931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2af953-4aa6-48bc-b160-aa70d7c0d69f None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:37.080543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 375/748] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:36 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:57:37.104227 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182a95b-e443-4043-a6e7-cf245fc60950 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:37.116011 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:37.167806 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2af953-4aa6-48bc-b160-aa70d7c0d69f None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:37.197270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:37.209647 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670751-0d80-4927-9339-3a1c1b4e5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:37.210846 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670751-0d80-4927-9339-3a1c1b4e5842 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:37.211228 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670751-0d80-4927-9339-3a1c1b4e5842 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:37.211518 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670751-0d80-4927-9339-3a1c1b4e5842 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:37.212343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670751-0d80-4927-9339-3a1c1b4e5842 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:37.212661 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670751-0d80-4927-9339-3a1c1b4e5842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:37.214037 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670751-0d80-4927-9339-3a1c1b4e5842 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:37.218924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 374/749] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:57:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:37.220238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182a95b-e443-4043-a6e7-cf245fc60950 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:37.224700 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670751-0d80-4927-9339-3a1c1b4e5842 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:37.260377 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdd9e1-8dbb-4f58-bb23-159187fcafaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:37.261193 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdd9e1-8dbb-4f58-bb23-159187fcafaf None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:37.261468 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdd9e1-8dbb-4f58-bb23-159187fcafaf None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:37.261907 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdd9e1-8dbb-4f58-bb23-159187fcafaf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:37.263373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdd9e1-8dbb-4f58-bb23-159187fcafaf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:37.264767 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdd9e1-8dbb-4f58-bb23-159187fcafaf None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-11cdd9e1-8dbb-4f58-bb23-159187fcafaf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:37.278879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:37.279880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:37.280761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 376/750] 10.222.0.98 () {56 vars in 1132 bytes} [Mon Jul 25 18:57:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:37.285816 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdd9e1-8dbb-4f58-bb23-159187fcafaf None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:37.340834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670751-0d80-4927-9339-3a1c1b4e5842 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:37.365625 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:37.375773 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5b6fc-42a9-4cb8-8c8a-6faff7eb5bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:37.376445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5b6fc-42a9-4cb8-8c8a-6faff7eb5bab None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:37.376736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5b6fc-42a9-4cb8-8c8a-6faff7eb5bab None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:37.377024 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5b6fc-42a9-4cb8-8c8a-6faff7eb5bab None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:37.377727 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5b6fc-42a9-4cb8-8c8a-6faff7eb5bab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:37.378038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5b6fc-42a9-4cb8-8c8a-6faff7eb5bab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:37.379444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5b6fc-42a9-4cb8-8c8a-6faff7eb5bab None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:37.401545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 375/751] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:57:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:37.401545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af5d8-12c8-4bf0-966e-dc02550457ee None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:37.401545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af5d8-12c8-4bf0-966e-dc02550457ee None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:37.401545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af5d8-12c8-4bf0-966e-dc02550457ee None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:37.401545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 376/752] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:37.402107 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdd9e1-8dbb-4f58-bb23-159187fcafaf None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:37.402207 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790e027-0060-4ad0-80ba-cd3d90ef7aad None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:37.402207 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790e027-0060-4ad0-80ba-cd3d90ef7aad None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:37.402207 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790e027-0060-4ad0-80ba-cd3d90ef7aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:37.416208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-a790e027-0060-4ad0-80ba-cd3d90ef7aad None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:37.417465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-a790e027-0060-4ad0-80ba-cd3d90ef7aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:37.435266 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7dea-a15c-447d-84d6-e71e7c5d28d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:37.436261 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7dea-a15c-447d-84d6-e71e7c5d28d8 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:37.436732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7dea-a15c-447d-84d6-e71e7c5d28d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:37.437186 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7dea-a15c-447d-84d6-e71e7c5d28d8 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:37.438166 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a7dea-a15c-447d-84d6-e71e7c5d28d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:37.438667 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a7dea-a15c-447d-84d6-e71e7c5d28d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:37.440378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a7dea-a15c-447d-84d6-e71e7c5d28d8 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:37.447104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 377/753] 10.222.0.98 () {56 vars in 1126 bytes} [Mon Jul 25 18:57:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:37.453301 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7dea-a15c-447d-84d6-e71e7c5d28d8 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:37.471866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:37.497406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 377/754] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:37 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:57:37.521817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790e027-0060-4ad0-80ba-cd3d90ef7aad None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:37.572179 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7dea-a15c-447d-84d6-e71e7c5d28d8 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:37.610138 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b289f-0d1b-43f5-85c0-6d5c34eecfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:37.610808 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b289f-0d1b-43f5-85c0-6d5c34eecfa5 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:37.611098 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b289f-0d1b-43f5-85c0-6d5c34eecfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:37.611484 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b289f-0d1b-43f5-85c0-6d5c34eecfa5 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:37.612211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b289f-0d1b-43f5-85c0-6d5c34eecfa5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:37.612522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b289f-0d1b-43f5-85c0-6d5c34eecfa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:37.613896 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b289f-0d1b-43f5-85c0-6d5c34eecfa5 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:37.618952 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 378/755] 10.222.0.98 () {56 vars in 1126 bytes} [Mon Jul 25 18:57:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:37.637971 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790e027-0060-4ad0-80ba-cd3d90ef7aad None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:37.681976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716e67-6e07-44ed-b879-dbbf699d2835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:37.682810 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716e67-6e07-44ed-b879-dbbf699d2835 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:37.683094 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716e67-6e07-44ed-b879-dbbf699d2835 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:37.683583 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716e67-6e07-44ed-b879-dbbf699d2835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:37.743925 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:37.767642 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716e67-6e07-44ed-b879-dbbf699d2835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:37.769025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716e67-6e07-44ed-b879-dbbf699d2835 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:37.877777 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 378/756] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:57:37 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 18:57:37.884918 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b289f-0d1b-43f5-85c0-6d5c34eecfa5 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:37.887927 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:37.998346 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b289f-0d1b-43f5-85c0-6d5c34eecfa5 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:38.033318 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acb177-7a14-4ea4-8c1d-97f82aaa78ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:38.034031 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acb177-7a14-4ea4-8c1d-97f82aaa78ed None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:38.034315 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acb177-7a14-4ea4-8c1d-97f82aaa78ed None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:38.034589 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acb177-7a14-4ea4-8c1d-97f82aaa78ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:38.045899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acb177-7a14-4ea4-8c1d-97f82aaa78ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:38.047444 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acb177-7a14-4ea4-8c1d-97f82aaa78ed None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-33acb177-7a14-4ea4-8c1d-97f82aaa78ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:57:38.065403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:38.066417 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:38.067349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:57:38.067349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:57:38.067349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:57:38.067349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:38.067349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 379/757] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:38.073208 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716e67-6e07-44ed-b879-dbbf699d2835 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:38.158621 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:38.180496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716e67-6e07-44ed-b879-dbbf699d2835 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:38.215663 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8b46b-79ee-4dfc-a3e8-22d059626e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:38.216329 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8b46b-79ee-4dfc-a3e8-22d059626e16 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:38.216614 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8b46b-79ee-4dfc-a3e8-22d059626e16 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:38.216890 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8b46b-79ee-4dfc-a3e8-22d059626e16 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:38.217605 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8b46b-79ee-4dfc-a3e8-22d059626e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:38.217913 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8b46b-79ee-4dfc-a3e8-22d059626e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:38.219312 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8b46b-79ee-4dfc-a3e8-22d059626e16 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:38.231278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 379/758] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:39.662590 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e66374-fb55-4038-8b06-0324ace5471f None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:39.663202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e66374-fb55-4038-8b06-0324ace5471f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:39.663202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e66374-fb55-4038-8b06-0324ace5471f None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:39.664696 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 380/759] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:39.670050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf002-313c-4866-b6b2-bc4bb4df3c0d None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:39.670457 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf002-313c-4866-b6b2-bc4bb4df3c0d None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:39.670630 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf002-313c-4866-b6b2-bc4bb4df3c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:39.690425 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-beddf002-313c-4866-b6b2-bc4bb4df3c0d None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:39.691676 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-beddf002-313c-4866-b6b2-bc4bb4df3c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:39.763408 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 380/760] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:39 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:39.787142 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e66374-fb55-4038-8b06-0324ace5471f None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:39.847822 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:39.890989 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f436e-bc2e-4de8-b9e2-2fea264e203b None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:39.891310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f436e-bc2e-4de8-b9e2-2fea264e203b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:39.891589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f436e-bc2e-4de8-b9e2-2fea264e203b None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:39.892934 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 381/761] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:39.897870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a1705-a8a5-4e5d-8015-1752f9391804 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:39.898166 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a1705-a8a5-4e5d-8015-1752f9391804 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:39.898273 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e66374-fb55-4038-8b06-0324ace5471f None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:39.898539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a1705-a8a5-4e5d-8015-1752f9391804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:39.916711 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-a38a1705-a8a5-4e5d-8015-1752f9391804 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:39.917846 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-a38a1705-a8a5-4e5d-8015-1752f9391804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:39.932810 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f01626-beed-4dca-b724-ec023d2bdd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:39.933466 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01626-beed-4dca-b724-ec023d2bdd8e None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:39.933753 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01626-beed-4dca-b724-ec023d2bdd8e None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:39.934027 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01626-beed-4dca-b724-ec023d2bdd8e None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:39.934804 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f01626-beed-4dca-b724-ec023d2bdd8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:39.936681 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f01626-beed-4dca-b724-ec023d2bdd8e None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:39.953108 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 381/762] 10.222.0.98 () {60 vars in 1141 bytes} [Mon Jul 25 18:57:39 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:39.984926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:39.996980 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 382/763] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:39 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:57:40.021635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f01626-beed-4dca-b724-ec023d2bdd8e None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:40.128803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f01626-beed-4dca-b724-ec023d2bdd8e None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:40.144806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:40.167059 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982200f-cc2a-4e4e-bd47-953605bca3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:40.167716 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982200f-cc2a-4e4e-bd47-953605bca3b5 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:40.168000 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982200f-cc2a-4e4e-bd47-953605bca3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:40.168277 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982200f-cc2a-4e4e-bd47-953605bca3b5 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:40.169004 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982200f-cc2a-4e4e-bd47-953605bca3b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:40.170387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982200f-cc2a-4e4e-bd47-953605bca3b5 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:40.186910 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 382/764] 10.222.0.98 () {60 vars in 1141 bytes} [Mon Jul 25 18:57:40 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:42.255814 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777788b2-9c4b-48b9-8f98-fc35d84605ba None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:42.256398 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777788b2-9c4b-48b9-8f98-fc35d84605ba None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:42.259513 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777788b2-9c4b-48b9-8f98-fc35d84605ba None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:42.261058 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 383/765] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:42.266210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935de3-6d5e-4652-a580-beaaa3449e19 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:42.266678 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935de3-6d5e-4652-a580-beaaa3449e19 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:42.266780 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935de3-6d5e-4652-a580-beaaa3449e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:42.284895 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-6b935de3-6d5e-4652-a580-beaaa3449e19 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:42.286095 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-6b935de3-6d5e-4652-a580-beaaa3449e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:42.363001 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 383/766] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:42 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:42.387567 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777788b2-9c4b-48b9-8f98-fc35d84605ba None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:42.458623 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034aca5-1673-4727-aea8-89e461201c17 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:42.458920 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034aca5-1673-4727-aea8-89e461201c17 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:42.459237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034aca5-1673-4727-aea8-89e461201c17 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:42.461175 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 384/767] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:42.466196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a580e-643b-4a02-a815-ba91778fbf3d None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:42.466483 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a580e-643b-4a02-a815-ba91778fbf3d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:42.466764 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a580e-643b-4a02-a815-ba91778fbf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:42.485241 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-520a580e-643b-4a02-a815-ba91778fbf3d None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:42.486443 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-520a580e-643b-4a02-a815-ba91778fbf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:42.490110 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777788b2-9c4b-48b9-8f98-fc35d84605ba None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:42.524620 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dd304-4f25-46d9-bbe2-ff553cb85164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:42.525350 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dd304-4f25-46d9-bbe2-ff553cb85164 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:42.525628 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dd304-4f25-46d9-bbe2-ff553cb85164 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:42.525902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dd304-4f25-46d9-bbe2-ff553cb85164 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:42.526544 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dd304-4f25-46d9-bbe2-ff553cb85164 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:42.527943 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dd304-4f25-46d9-bbe2-ff553cb85164 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-260dd304-4f25-46d9-bbe2-ff553cb85164 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:42.540193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:42.541438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:42.542359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 384/768] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:57:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:42.547243 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dd304-4f25-46d9-bbe2-ff553cb85164 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:42.556723 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 385/769] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:42 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:57:42.580822 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a580e-643b-4a02-a815-ba91778fbf3d None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:42.606148 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:42.611923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:42.650926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dd304-4f25-46d9-bbe2-ff553cb85164 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:42.685505 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747780-3912-4d30-ab6c-02e6c628da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:42.686172 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747780-3912-4d30-ab6c-02e6c628da1b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:42.686367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a580e-643b-4a02-a815-ba91778fbf3d None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:42.686489 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747780-3912-4d30-ab6c-02e6c628da1b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:42.686724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66747780-3912-4d30-ab6c-02e6c628da1b None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:42.687465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747780-3912-4d30-ab6c-02e6c628da1b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:42.687847 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747780-3912-4d30-ab6c-02e6c628da1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:42.689128 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66747780-3912-4d30-ab6c-02e6c628da1b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:42.694145 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 385/770] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:57:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:42.699913 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747780-3912-4d30-ab6c-02e6c628da1b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:42.721500 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14d4a-d285-4ecd-9b22-0d4ba219d4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:42.722304 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14d4a-d285-4ecd-9b22-0d4ba219d4b0 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:42.722589 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14d4a-d285-4ecd-9b22-0d4ba219d4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:42.722869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14d4a-d285-4ecd-9b22-0d4ba219d4b0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:42.723536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c14d4a-d285-4ecd-9b22-0d4ba219d4b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:42.724904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c14d4a-d285-4ecd-9b22-0d4ba219d4b0 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-c8c14d4a-d285-4ecd-9b22-0d4ba219d4b0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:42.738191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:42.739208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:42.740066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 386/771] 10.222.0.98 () {56 vars in 1132 bytes} [Mon Jul 25 18:57:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:42.746059 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14d4a-d285-4ecd-9b22-0d4ba219d4b0 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:42.802590 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66747780-3912-4d30-ab6c-02e6c628da1b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:42.825933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:42.837226 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06b07a-8a2c-4cc1-a9ad-b5721aa7270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:42.837888 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06b07a-8a2c-4cc1-a9ad-b5721aa7270a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:42.838172 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06b07a-8a2c-4cc1-a9ad-b5721aa7270a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:42.838448 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06b07a-8a2c-4cc1-a9ad-b5721aa7270a None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:42.839183 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06b07a-8a2c-4cc1-a9ad-b5721aa7270a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:42.839494 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06b07a-8a2c-4cc1-a9ad-b5721aa7270a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:42.840850 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06b07a-8a2c-4cc1-a9ad-b5721aa7270a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:42.841677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:42.845875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 386/772] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:57:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:42.852328 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06b07a-8a2c-4cc1-a9ad-b5721aa7270a None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:42.852484 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14d4a-d285-4ecd-9b22-0d4ba219d4b0 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:42.886084 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84299afd-c024-4546-a724-95e8725dd6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:42.886752 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299afd-c024-4546-a724-95e8725dd6d3 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:42.887036 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299afd-c024-4546-a724-95e8725dd6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:42.887359 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299afd-c024-4546-a724-95e8725dd6d3 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:42.888062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84299afd-c024-4546-a724-95e8725dd6d3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:42.888369 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84299afd-c024-4546-a724-95e8725dd6d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:42.889739 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84299afd-c024-4546-a724-95e8725dd6d3 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:42.894407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 387/773] 10.222.0.98 () {56 vars in 1126 bytes} [Mon Jul 25 18:57:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:42.900363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84299afd-c024-4546-a724-95e8725dd6d3 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:42.950407 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06b07a-8a2c-4cc1-a9ad-b5721aa7270a None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:42.986519 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513b25c-edc4-4587-9533-4ad74196c78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:42.987205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513b25c-edc4-4587-9533-4ad74196c78d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:42.987494 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513b25c-edc4-4587-9533-4ad74196c78d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:42.987771 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513b25c-edc4-4587-9533-4ad74196c78d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:42.988562 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513b25c-edc4-4587-9533-4ad74196c78d None admin] RBAC: Adding query filter params (interface=public, service_id=2fd82316e90a41da9f823de284932d5f, region_id=RegionOne) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:42.988878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513b25c-edc4-4587-9533-4ad74196c78d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:42.990245 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513b25c-edc4-4587-9533-4ad74196c78d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:42.995820 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 387/774] 10.222.0.98 () {56 vars in 1251 bytes} [Mon Jul 25 18:57:42 2022] GET /identity/v3/endpoints?service_id=2fd82316e90a41da9f823de284932d5f&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:43.001230 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513b25c-edc4-4587-9533-4ad74196c78d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:43.002043 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84299afd-c024-4546-a724-95e8725dd6d3 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:43.036498 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bf708-a2a1-4da0-b07c-1f95fc545b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:43.037161 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bf708-a2a1-4da0-b07c-1f95fc545b42 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:43.037443 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bf708-a2a1-4da0-b07c-1f95fc545b42 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:43.037716 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bf708-a2a1-4da0-b07c-1f95fc545b42 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:43.038953 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bf708-a2a1-4da0-b07c-1f95fc545b42 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:43.039292 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bf708-a2a1-4da0-b07c-1f95fc545b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:43.040670 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bf708-a2a1-4da0-b07c-1f95fc545b42 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:43.045649 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 388/775] 10.222.0.98 () {56 vars in 1126 bytes} [Mon Jul 25 18:57:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:43.051492 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bf708-a2a1-4da0-b07c-1f95fc545b42 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:43.056914 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:43.076333 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:43.105354 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513b25c-edc4-4587-9533-4ad74196c78d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:43.139733 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3eb0c-be54-4992-a49d-70c404d78a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:43.140390 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3eb0c-be54-4992-a49d-70c404d78a38 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:43.140676 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3eb0c-be54-4992-a49d-70c404d78a38 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:43.140950 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3eb0c-be54-4992-a49d-70c404d78a38 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:43.141626 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3eb0c-be54-4992-a49d-70c404d78a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:43.142989 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3eb0c-be54-4992-a49d-70c404d78a38 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:43.149833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 388/776] 10.222.0.98 () {56 vars in 1087 bytes} [Mon Jul 25 18:57:43 2022] GET /identity/v3/services => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 18:57:43.151496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bf708-a2a1-4da0-b07c-1f95fc545b42 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:43.189621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe65b09-0a6e-486b-9259-8b36adff289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:43.190297 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe65b09-0a6e-486b-9259-8b36adff289f None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:43.190586 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe65b09-0a6e-486b-9259-8b36adff289f None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:43.190864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe65b09-0a6e-486b-9259-8b36adff289f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:43.191708 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe65b09-0a6e-486b-9259-8b36adff289f None admin] RBAC: Adding query filter params (interface=public, service_id=377936e7dfaa4393816e45d724ccc865, region_id=RegionOne) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:43.192026 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe65b09-0a6e-486b-9259-8b36adff289f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:43.193427 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe65b09-0a6e-486b-9259-8b36adff289f None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:43.200029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 389/777] 10.222.0.98 () {56 vars in 1251 bytes} [Mon Jul 25 18:57:43 2022] GET /identity/v3/endpoints?service_id=377936e7dfaa4393816e45d724ccc865&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:43.205846 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3eb0c-be54-4992-a49d-70c404d78a38 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:43.315617 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3eb0c-be54-4992-a49d-70c404d78a38 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:43.334377 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:43.353752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80835242-2411-49ca-b384-d1a83b10363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:43.354422 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80835242-2411-49ca-b384-d1a83b10363c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:43.354711 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80835242-2411-49ca-b384-d1a83b10363c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:43.354993 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80835242-2411-49ca-b384-d1a83b10363c None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:43.355709 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80835242-2411-49ca-b384-d1a83b10363c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:43.357082 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80835242-2411-49ca-b384-d1a83b10363c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:43.363281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 389/778] 10.222.0.98 () {56 vars in 1087 bytes} [Mon Jul 25 18:57:43 2022] GET /identity/v3/services => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 18:57:45.390447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1541-5a83-4863-a81d-97b757e1c49d None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:45.391007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1541-5a83-4863-a81d-97b757e1c49d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:45.391007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1541-5a83-4863-a81d-97b757e1c49d None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:45.392383 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 390/779] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:45.397574 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84856d2f-0d7f-4200-82ea-3eab81cf5bba None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:45.398649 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84856d2f-0d7f-4200-82ea-3eab81cf5bba None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:45.398836 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84856d2f-0d7f-4200-82ea-3eab81cf5bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:45.416721 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-84856d2f-0d7f-4200-82ea-3eab81cf5bba None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:45.417905 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-84856d2f-0d7f-4200-82ea-3eab81cf5bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:45.488942 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 390/780] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:45 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:45.513739 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1541-5a83-4863-a81d-97b757e1c49d None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:45.602113 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:45.613384 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67f4c-dc56-4859-9bbe-6066e2f24dfc None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:45.613676 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67f4c-dc56-4859-9bbe-6066e2f24dfc None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:45.613959 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67f4c-dc56-4859-9bbe-6066e2f24dfc None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:45.615347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 391/781] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:45.619872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1541-5a83-4863-a81d-97b757e1c49d None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:45.620898 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9e826-702a-4e13-9b4c-e2ea58cadd0b None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:45.621194 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9e826-702a-4e13-9b4c-e2ea58cadd0b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:45.621651 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9e826-702a-4e13-9b4c-e2ea58cadd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:45.640135 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-5dd9e826-702a-4e13-9b4c-e2ea58cadd0b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:45.641389 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-5dd9e826-702a-4e13-9b4c-e2ea58cadd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:45.656396 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65302ba2-18de-460f-8235-e4af9c43186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:45.657193 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302ba2-18de-460f-8235-e4af9c43186a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:45.657483 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302ba2-18de-460f-8235-e4af9c43186a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:45.657757 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302ba2-18de-460f-8235-e4af9c43186a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:45.658403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65302ba2-18de-460f-8235-e4af9c43186a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:45.659844 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65302ba2-18de-460f-8235-e4af9c43186a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-65302ba2-18de-460f-8235-e4af9c43186a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:45.671774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:45.672806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:45.673735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 391/782] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:57:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:45.679492 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65302ba2-18de-460f-8235-e4af9c43186a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:45.712410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 392/783] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:45 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:57:45.736191 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9e826-702a-4e13-9b4c-e2ea58cadd0b None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:45.780201 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:45.782457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65302ba2-18de-460f-8235-e4af9c43186a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:45.815991 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13d37e-48ae-464f-be6a-8cc82de590ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:45.816650 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13d37e-48ae-464f-be6a-8cc82de590ac None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:45.816936 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13d37e-48ae-464f-be6a-8cc82de590ac None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:45.817212 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13d37e-48ae-464f-be6a-8cc82de590ac None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:45.817904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13d37e-48ae-464f-be6a-8cc82de590ac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:45.818213 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13d37e-48ae-464f-be6a-8cc82de590ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:45.820197 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13d37e-48ae-464f-be6a-8cc82de590ac None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:45.824995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 392/784] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:57:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:45.830662 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13d37e-48ae-464f-be6a-8cc82de590ac None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:45.841076 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9e826-702a-4e13-9b4c-e2ea58cadd0b None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:45.846579 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:45.877407 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57790-b5d9-447a-81b7-db6fb0a42d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:45.878331 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57790-b5d9-447a-81b7-db6fb0a42d24 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:45.878726 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57790-b5d9-447a-81b7-db6fb0a42d24 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:45.878997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57790-b5d9-447a-81b7-db6fb0a42d24 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:45.879670 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d57790-b5d9-447a-81b7-db6fb0a42d24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:45.881036 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d57790-b5d9-447a-81b7-db6fb0a42d24 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-b8d57790-b5d9-447a-81b7-db6fb0a42d24 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:45.893866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:45.894811 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:45.895683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 393/785] 10.222.0.98 () {56 vars in 1132 bytes} [Mon Jul 25 18:57:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:45.901059 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57790-b5d9-447a-81b7-db6fb0a42d24 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:45.941790 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13d37e-48ae-464f-be6a-8cc82de590ac None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:45.975120 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717a9b9-5196-4a88-8fdc-1b50125f2579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:45.976462 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717a9b9-5196-4a88-8fdc-1b50125f2579 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:45.976919 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717a9b9-5196-4a88-8fdc-1b50125f2579 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:45.977769 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717a9b9-5196-4a88-8fdc-1b50125f2579 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:45.978752 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717a9b9-5196-4a88-8fdc-1b50125f2579 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:45.979709 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717a9b9-5196-4a88-8fdc-1b50125f2579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:45.981224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717a9b9-5196-4a88-8fdc-1b50125f2579 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:45.990310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 393/786] 10.222.0.98 () {56 vars in 1114 bytes} [Mon Jul 25 18:57:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:45.996979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717a9b9-5196-4a88-8fdc-1b50125f2579 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:46.002611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57790-b5d9-447a-81b7-db6fb0a42d24 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:46.004915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:46.037876 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc068c0-396a-4d21-8e13-82246ee392d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:46.039581 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc068c0-396a-4d21-8e13-82246ee392d9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:46.039867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc068c0-396a-4d21-8e13-82246ee392d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:46.040143 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc068c0-396a-4d21-8e13-82246ee392d9 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:46.040840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc068c0-396a-4d21-8e13-82246ee392d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:46.041144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc068c0-396a-4d21-8e13-82246ee392d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:46.042500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc068c0-396a-4d21-8e13-82246ee392d9 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:46.047192 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 394/787] 10.222.0.98 () {56 vars in 1126 bytes} [Mon Jul 25 18:57:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:46.052910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc068c0-396a-4d21-8e13-82246ee392d9 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:46.077821 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:46.099455 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717a9b9-5196-4a88-8fdc-1b50125f2579 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:46.134800 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bb929-ea0e-4d0f-b05a-401c707cb5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:46.135485 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bb929-ea0e-4d0f-b05a-401c707cb5ff None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:46.135771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bb929-ea0e-4d0f-b05a-401c707cb5ff None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:46.136052 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bb929-ea0e-4d0f-b05a-401c707cb5ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:46.136783 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bb929-ea0e-4d0f-b05a-401c707cb5ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:46.138156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bb929-ea0e-4d0f-b05a-401c707cb5ff None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:46.155928 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc068c0-396a-4d21-8e13-82246ee392d9 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:46.158162 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 394/788] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 18:57:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:46.199626 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d938885-ac85-4d9a-be80-3bce1fab2cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:46.200377 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938885-ac85-4d9a-be80-3bce1fab2cb7 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:46.200651 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938885-ac85-4d9a-be80-3bce1fab2cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:46.200842 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938885-ac85-4d9a-be80-3bce1fab2cb7 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:46.201528 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d938885-ac85-4d9a-be80-3bce1fab2cb7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:46.201832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d938885-ac85-4d9a-be80-3bce1fab2cb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:46.203243 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d938885-ac85-4d9a-be80-3bce1fab2cb7 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:46.208656 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 395/789] 10.222.0.98 () {56 vars in 1126 bytes} [Mon Jul 25 18:57:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:46.215864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bb929-ea0e-4d0f-b05a-401c707cb5ff None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:46.324264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bb929-ea0e-4d0f-b05a-401c707cb5ff None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:46.360933 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189c7b6-695f-4cbb-a868-76b40182af03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:46.361597 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189c7b6-695f-4cbb-a868-76b40182af03 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:46.361876 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189c7b6-695f-4cbb-a868-76b40182af03 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:46.362149 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189c7b6-695f-4cbb-a868-76b40182af03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:46.362908 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189c7b6-695f-4cbb-a868-76b40182af03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:46.364291 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189c7b6-695f-4cbb-a868-76b40182af03 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:46.369478 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:46.386688 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 395/790] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 18:57:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:57:48.425983 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855447-7cfe-42ae-a2f5-e385785e6353 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:48.426546 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855447-7cfe-42ae-a2f5-e385785e6353 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:48.426546 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855447-7cfe-42ae-a2f5-e385785e6353 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:48.428066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 396/791] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:48.433709 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ad344-b3b2-4b5a-81bb-ba80675dbfd8 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:48.434143 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ad344-b3b2-4b5a-81bb-ba80675dbfd8 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:48.434273 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ad344-b3b2-4b5a-81bb-ba80675dbfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:48.452648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-0b5ad344-b3b2-4b5a-81bb-ba80675dbfd8 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:48.453911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-0b5ad344-b3b2-4b5a-81bb-ba80675dbfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:48.530326 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 396/792] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:48 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:48.555728 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855447-7cfe-42ae-a2f5-e385785e6353 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:48.587024 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:48.654832 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad6e27-f9e6-41d6-ae93-5558992c47fe None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:48.655267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad6e27-f9e6-41d6-ae93-5558992c47fe None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:48.655624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad6e27-f9e6-41d6-ae93-5558992c47fe None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:48.657051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 397/793] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:48.661845 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c8e1f-1d04-4b9b-ba3b-b0f2376b84b5 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:48.662133 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c8e1f-1d04-4b9b-ba3b-b0f2376b84b5 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:48.662398 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855447-7cfe-42ae-a2f5-e385785e6353 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:48.662503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c8e1f-1d04-4b9b-ba3b-b0f2376b84b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:48.684135 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-c03c8e1f-1d04-4b9b-ba3b-b0f2376b84b5 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:48.685272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-c03c8e1f-1d04-4b9b-ba3b-b0f2376b84b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:48.697282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83402718-0495-4253-881e-02f06047c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:48.697943 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83402718-0495-4253-881e-02f06047c3ef None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:48.698225 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83402718-0495-4253-881e-02f06047c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:48.698496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83402718-0495-4253-881e-02f06047c3ef None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:48.699229 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83402718-0495-4253-881e-02f06047c3ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:48.700784 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83402718-0495-4253-881e-02f06047c3ef None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:48.703932 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: WARNING keystone.server.flask.common [None req-83402718-0495-4253-881e-02f06047c3ef None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 18:57:48.721615 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.sql.core [None req-83402718-0495-4253-881e-02f06047c3ef None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 18:57:48.721615 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 18:57:48.721615 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [parameters: {'id': '3628747261e84e0782b2e3ed6a62d43e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 18:57:48.721615 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87413) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-83402718-0495-4253-881e-02f06047c3ef None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3628747261e84e0782b2e3ed6a62d43e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3628747261e84e0782b2e3ed6a62d43e. Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application conn.query(q) Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 18:57:48.738316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application result.read() Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 18:57:48.739278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application next(self.gen) Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application yield resource Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application next(self.gen) Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise self.value Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application session.commit() Jul 25 18:57:48.740394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self.session.flush() Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application compat.raise_( Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 18:57:48.741924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 18:57:48.742920 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application conn.query(q) Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application result.read() Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 18:57:48.743854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [parameters: {'id': '3628747261e84e0782b2e3ed6a62d43e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:48.744749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:48.745539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:48.746468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:48.746468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 18:57:48.746468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 18:57:48.746468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:48.746468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:48.746468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 18:57:48.746468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 18:57:48.746468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3628747261e84e0782b2e3ed6a62d43e. Jul 25 18:57:48.746468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:48.746468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 397/794] 10.222.0.98 () {60 vars in 1140 bytes} [Mon Jul 25 18:57:48 2022] POST /identity/v3/projects => generated 262 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:48.747500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83402718-0495-4253-881e-02f06047c3ef None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:48.758397 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 398/795] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:48 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:57:48.782383 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c8e1f-1d04-4b9b-ba3b-b0f2376b84b5 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:48.830305 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:48.837194 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:48.854619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83402718-0495-4253-881e-02f06047c3ef None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:48.887665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c8e1f-1d04-4b9b-ba3b-b0f2376b84b5 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:48.888637 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564461e9-6072-44f8-9902-bf902e50f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:48.889437 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564461e9-6072-44f8-9902-bf902e50f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:48.889720 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564461e9-6072-44f8-9902-bf902e50f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:48.889998 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564461e9-6072-44f8-9902-bf902e50f3d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:48.896701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564461e9-6072-44f8-9902-bf902e50f3d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:48.898477 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564461e9-6072-44f8-9902-bf902e50f3d2 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-564461e9-6072-44f8-9902-bf902e50f3d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:57:48.912589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:48.914352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:48.915273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:57:48.915273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:57:48.915273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:57:48.915273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:57:48.915273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:57:48.915273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:57:48.915273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:57:48.915273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:48.915273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 398/796] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:48.920620 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564461e9-6072-44f8-9902-bf902e50f3d2 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:48.925934 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bae376-bf4f-4822-a109-e1e601f34d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:48.926725 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bae376-bf4f-4822-a109-e1e601f34d45 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:48.927006 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bae376-bf4f-4822-a109-e1e601f34d45 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:48.927326 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bae376-bf4f-4822-a109-e1e601f34d45 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:48.928061 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bae376-bf4f-4822-a109-e1e601f34d45 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:48.930005 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bae376-bf4f-4822-a109-e1e601f34d45 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-22bae376-bf4f-4822-a109-e1e601f34d45 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:48.942155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:48.943230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:48.944104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 399/797] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:48.949489 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bae376-bf4f-4822-a109-e1e601f34d45 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:49.024553 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564461e9-6072-44f8-9902-bf902e50f3d2 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:49.052737 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bae376-bf4f-4822-a109-e1e601f34d45 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:49.060137 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27bd81-7208-45db-ad5f-6de2218f7ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:49.060800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bd81-7208-45db-ad5f-6de2218f7ed3 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:49.061085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bd81-7208-45db-ad5f-6de2218f7ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:49.061363 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bd81-7208-45db-ad5f-6de2218f7ed3 None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:49.062114 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27bd81-7208-45db-ad5f-6de2218f7ed3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:49.062431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27bd81-7208-45db-ad5f-6de2218f7ed3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:49.063888 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27bd81-7208-45db-ad5f-6de2218f7ed3 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:49.064002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:49.083716 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 399/798] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:49.088566 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078779b2-8bd6-44cb-810c-8f1e1f3bb80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:49.089246 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078779b2-8bd6-44cb-810c-8f1e1f3bb80c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:49.089530 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078779b2-8bd6-44cb-810c-8f1e1f3bb80c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:49.089806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078779b2-8bd6-44cb-810c-8f1e1f3bb80c None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:49.090524 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078779b2-8bd6-44cb-810c-8f1e1f3bb80c None admin] RBAC: Adding query filter params (name=compute) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:49.090834 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078779b2-8bd6-44cb-810c-8f1e1f3bb80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:49.092318 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078779b2-8bd6-44cb-810c-8f1e1f3bb80c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:49.097820 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 400/799] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:57:49.104515 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27bd81-7208-45db-ad5f-6de2218f7ed3 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:49.109248 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:49.213258 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27bd81-7208-45db-ad5f-6de2218f7ed3 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:49.249826 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61db33-4927-4bf6-8564-8a3a6ca6bbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:49.250492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61db33-4927-4bf6-8564-8a3a6ca6bbea None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:49.251449 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61db33-4927-4bf6-8564-8a3a6ca6bbea None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:49.251807 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61db33-4927-4bf6-8564-8a3a6ca6bbea None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:49.252609 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61db33-4927-4bf6-8564-8a3a6ca6bbea None admin] RBAC: Adding query filter params (type=compute) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:49.252921 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61db33-4927-4bf6-8564-8a3a6ca6bbea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:49.254298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61db33-4927-4bf6-8564-8a3a6ca6bbea None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:49.259612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 400/800] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:51.407938 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a64985-4da3-4d29-818f-8f3ed32451c3 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:51.408467 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a64985-4da3-4d29-818f-8f3ed32451c3 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:51.408467 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a64985-4da3-4d29-818f-8f3ed32451c3 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:51.409843 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 401/801] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:51.415255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dde27-bcaf-4867-8408-f058213173ed None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:51.415658 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dde27-bcaf-4867-8408-f058213173ed None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:51.415818 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dde27-bcaf-4867-8408-f058213173ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:51.436291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-168dde27-bcaf-4867-8408-f058213173ed None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:51.437823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-168dde27-bcaf-4867-8408-f058213173ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:51.490397 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d407c4-eb77-40ff-af3b-0773d6ac1d4c None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:51.490677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d407c4-eb77-40ff-af3b-0773d6ac1d4c None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:51.490955 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d407c4-eb77-40ff-af3b-0773d6ac1d4c None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:51.492897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 402/802] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:57:51.497915 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ecd10-f622-4600-86a3-e98106f96ba9 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:51.498203 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ecd10-f622-4600-86a3-e98106f96ba9 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:51.498482 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ecd10-f622-4600-86a3-e98106f96ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:51.499583 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:51.505474 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 401/803] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:51 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:51.518846 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-3c3ecd10-f622-4600-86a3-e98106f96ba9 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:51.520156 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-3c3ecd10-f622-4600-86a3-e98106f96ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:51.531572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168dde27-bcaf-4867-8408-f058213173ed None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:51.587019 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 403/804] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:51 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:57:51.610590 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ecd10-f622-4600-86a3-e98106f96ba9 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:51.633876 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168dde27-bcaf-4867-8408-f058213173ed None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:51.668453 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4e628-8ad2-4083-aa9a-1ec20961b61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:51.669057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4e628-8ad2-4083-aa9a-1ec20961b61f None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:51.669341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4e628-8ad2-4083-aa9a-1ec20961b61f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:51.669620 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4e628-8ad2-4083-aa9a-1ec20961b61f None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:51.670318 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4e628-8ad2-4083-aa9a-1ec20961b61f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:51.671789 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4e628-8ad2-4083-aa9a-1ec20961b61f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:51.686501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.sql.core [None req-4bf4e628-8ad2-4083-aa9a-1ec20961b61f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 18:57:51.686501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 18:57:51.686501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [parameters: {'user_id': '3153bc02804e4382aeecd246f80b6080', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 18:57:51.686501 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87413) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-4bf4e628-8ad2-4083-aa9a-1ec20961b61f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application conn.query(q) Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application result.read() Jul 25 18:57:51.693851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 18:57:51.695724 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application next(self.gen) Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application yield resource Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application next(self.gen) Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise self.value Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application session.commit() Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 18:57:51.696675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self.session.flush() Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application compat.raise_( Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 18:57:51.697551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 18:57:51.698431 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application conn.query(q) Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application result.read() Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 18:57:51.699300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [parameters: {'user_id': '3153bc02804e4382aeecd246f80b6080', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:51.700109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 18:57:51.700899 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 18:57:51.701833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 18:57:51.701833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 18:57:51.701833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 18:57:51.701833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 18:57:51.701833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 18:57:51.701833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:51.701833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 402/805] 10.222.0.98 () {60 vars in 1131 bytes} [Mon Jul 25 18:57:51 2022] POST /identity/v3/users => generated 160 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:57:51.702220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4e628-8ad2-4083-aa9a-1ec20961b61f None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:51.717539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ecd10-f622-4600-86a3-e98106f96ba9 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:51.719818 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:51.752224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743276-77de-44e4-a297-d77514478327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:51.752883 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743276-77de-44e4-a297-d77514478327 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:51.753162 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743276-77de-44e4-a297-d77514478327 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:51.753435 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743276-77de-44e4-a297-d77514478327 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:51.754141 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85743276-77de-44e4-a297-d77514478327 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:51.755543 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85743276-77de-44e4-a297-d77514478327 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:51.763152 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:51.772033 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 404/806] 10.222.0.98 () {60 vars in 1141 bytes} [Mon Jul 25 18:57:51 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 18:57:51.809908 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4e628-8ad2-4083-aa9a-1ec20961b61f None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:51.858386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81176d-b5f8-40e6-a8f7-462c44825dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:51.859222 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81176d-b5f8-40e6-a8f7-462c44825dff None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:51.859508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81176d-b5f8-40e6-a8f7-462c44825dff None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:51.859783 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81176d-b5f8-40e6-a8f7-462c44825dff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:51.868699 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81176d-b5f8-40e6-a8f7-462c44825dff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:51.870296 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81176d-b5f8-40e6-a8f7-462c44825dff None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-3a81176d-b5f8-40e6-a8f7-462c44825dff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:57:51.885701 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:51.886875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:51.888256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 403/807] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:57:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:51.893031 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743276-77de-44e4-a297-d77514478327 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:52.007450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743276-77de-44e4-a297-d77514478327 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:52.042854 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab53398-623a-49ab-98f1-58bf0d9736f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:52.043780 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53398-623a-49ab-98f1-58bf0d9736f4 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:52.044161 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53398-623a-49ab-98f1-58bf0d9736f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:52.044534 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53398-623a-49ab-98f1-58bf0d9736f4 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:52.045378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab53398-623a-49ab-98f1-58bf0d9736f4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:52.045692 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab53398-623a-49ab-98f1-58bf0d9736f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:52.047169 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab53398-623a-49ab-98f1-58bf0d9736f4 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:52.082483 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 405/808] 10.222.0.98 () {56 vars in 1101 bytes} [Mon Jul 25 18:57:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:54.108178 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdb25b-664f-46db-8043-5a3dc6d59128 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:54.108712 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdb25b-664f-46db-8043-5a3dc6d59128 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:54.108712 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdb25b-664f-46db-8043-5a3dc6d59128 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:54.110085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 404/809] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:54.115405 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfa73c-d5c3-4132-a128-0a245f1c23de None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:54.115820 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfa73c-d5c3-4132-a128-0a245f1c23de None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:54.115967 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfa73c-d5c3-4132-a128-0a245f1c23de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:54.134887 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-bbdfa73c-d5c3-4132-a128-0a245f1c23de None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:54.136240 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-bbdfa73c-d5c3-4132-a128-0a245f1c23de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:54.152799 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:54.203031 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 406/810] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:54 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:57:54.227765 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdb25b-664f-46db-8043-5a3dc6d59128 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:54.326892 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdb25b-664f-46db-8043-5a3dc6d59128 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:54.342267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:54.360008 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609695-bbbd-4f0d-81d8-b93d0ad4f382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:54.360733 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609695-bbbd-4f0d-81d8-b93d0ad4f382 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:54.361018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609695-bbbd-4f0d-81d8-b93d0ad4f382 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:54.361296 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609695-bbbd-4f0d-81d8-b93d0ad4f382 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:54.361935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3609695-bbbd-4f0d-81d8-b93d0ad4f382 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:54.363319 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3609695-bbbd-4f0d-81d8-b93d0ad4f382 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-a3609695-bbbd-4f0d-81d8-b93d0ad4f382 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:54.375341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:54.376512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:57:54.377718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 405/811] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:54.382838 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfa73c-d5c3-4132-a128-0a245f1c23de None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:54.481786 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfa73c-d5c3-4132-a128-0a245f1c23de None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:54.515490 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa14f1-d98c-4c54-9eae-4e95cbad494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:54.516166 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa14f1-d98c-4c54-9eae-4e95cbad494a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:54.516447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa14f1-d98c-4c54-9eae-4e95cbad494a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:54.516750 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa14f1-d98c-4c54-9eae-4e95cbad494a None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:54.517444 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa14f1-d98c-4c54-9eae-4e95cbad494a None admin] RBAC: Adding query filter params (name=compute) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:54.517749 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa14f1-d98c-4c54-9eae-4e95cbad494a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:54.519154 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa14f1-d98c-4c54-9eae-4e95cbad494a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:54.524561 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 407/812] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:54.530266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609695-bbbd-4f0d-81d8-b93d0ad4f382 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:54.629222 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609695-bbbd-4f0d-81d8-b93d0ad4f382 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:54.662224 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dbe99-3459-4ded-aa47-ab8321b33b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:54.665236 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dbe99-3459-4ded-aa47-ab8321b33b72 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:54.665563 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dbe99-3459-4ded-aa47-ab8321b33b72 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:54.665837 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dbe99-3459-4ded-aa47-ab8321b33b72 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:54.666549 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dbe99-3459-4ded-aa47-ab8321b33b72 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:54.666853 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dbe99-3459-4ded-aa47-ab8321b33b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:54.668242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dbe99-3459-4ded-aa47-ab8321b33b72 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:54.673275 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 406/813] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:54.679370 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa14f1-d98c-4c54-9eae-4e95cbad494a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:54.697581 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:54.780031 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa14f1-d98c-4c54-9eae-4e95cbad494a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:54.813409 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118ebb7-f616-49c7-a880-755e8760d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:54.814055 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118ebb7-f616-49c7-a880-755e8760d769 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:54.814339 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118ebb7-f616-49c7-a880-755e8760d769 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:54.814608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118ebb7-f616-49c7-a880-755e8760d769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:54.815408 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118ebb7-f616-49c7-a880-755e8760d769 None admin] RBAC: Adding query filter params (interface=public, service_id=d364db533b134b6aaa59c366c96fb88a, region_id=RegionOne) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:54.815719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118ebb7-f616-49c7-a880-755e8760d769 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:54.817116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118ebb7-f616-49c7-a880-755e8760d769 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:54.822719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 408/814] 10.222.0.98 () {56 vars in 1251 bytes} [Mon Jul 25 18:57:54 2022] GET /identity/v3/endpoints?service_id=d364db533b134b6aaa59c366c96fb88a&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:54.829402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dbe99-3459-4ded-aa47-ab8321b33b72 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:54.874338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:54.931191 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dbe99-3459-4ded-aa47-ab8321b33b72 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:54.964737 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb5c6-57a0-403c-8847-4f90075eb39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:54.965395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb5c6-57a0-403c-8847-4f90075eb39b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:54.965680 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb5c6-57a0-403c-8847-4f90075eb39b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:54.965959 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb5c6-57a0-403c-8847-4f90075eb39b None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:54.966632 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb5c6-57a0-403c-8847-4f90075eb39b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:54.968019 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb5c6-57a0-403c-8847-4f90075eb39b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:54.974073 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 407/815] 10.222.0.98 () {56 vars in 1087 bytes} [Mon Jul 25 18:57:54 2022] GET /identity/v3/services => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 18:57:57.213225 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698753d-ecc7-434f-8d7e-3addbcf65f2e None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:57.213793 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698753d-ecc7-434f-8d7e-3addbcf65f2e None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:57.213793 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698753d-ecc7-434f-8d7e-3addbcf65f2e None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:57.215144 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 409/816] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:57:57.220402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832103-a051-488b-9b68-ed036e3ca5f0 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:57.220820 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832103-a051-488b-9b68-ed036e3ca5f0 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:57.220964 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832103-a051-488b-9b68-ed036e3ca5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:57.239470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-fa832103-a051-488b-9b68-ed036e3ca5f0 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:57:57.241587 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-fa832103-a051-488b-9b68-ed036e3ca5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:57:57.310877 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 408/817] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:57:57 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:57:57.334382 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698753d-ecc7-434f-8d7e-3addbcf65f2e None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:57.417442 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:57.437775 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698753d-ecc7-434f-8d7e-3addbcf65f2e None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:57.471254 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846da219-79ba-44af-9c7b-780384cb03a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:57.471971 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846da219-79ba-44af-9c7b-780384cb03a5 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:57.472255 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846da219-79ba-44af-9c7b-780384cb03a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:57.472525 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846da219-79ba-44af-9c7b-780384cb03a5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:57.473157 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846da219-79ba-44af-9c7b-780384cb03a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:57.474536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846da219-79ba-44af-9c7b-780384cb03a5 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-846da219-79ba-44af-9c7b-780384cb03a5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:57:57.486614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:57:57.487809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:57:57.488859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 410/818] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:57:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:57:57.494438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa832103-a051-488b-9b68-ed036e3ca5f0 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:57.533132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:57.591343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa832103-a051-488b-9b68-ed036e3ca5f0 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:57.624399 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf8678-c061-4688-9606-05aa48cb6def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:57.625049 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf8678-c061-4688-9606-05aa48cb6def None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:57.625335 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf8678-c061-4688-9606-05aa48cb6def None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:57.625612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf8678-c061-4688-9606-05aa48cb6def None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:57.626306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf8678-c061-4688-9606-05aa48cb6def None admin] RBAC: Adding query filter params (name=compute) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:57.626617 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf8678-c061-4688-9606-05aa48cb6def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:57.628000 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf8678-c061-4688-9606-05aa48cb6def None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:57.633122 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 409/819] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:57.638939 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846da219-79ba-44af-9c7b-780384cb03a5 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:57.740580 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846da219-79ba-44af-9c7b-780384cb03a5 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:57.774199 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbf603-d31d-48f2-ab70-2e73b549d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:57.774853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbf603-d31d-48f2-ab70-2e73b549d847 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:57.775154 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbf603-d31d-48f2-ab70-2e73b549d847 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:57.775445 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbf603-d31d-48f2-ab70-2e73b549d847 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:57.776137 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbf603-d31d-48f2-ab70-2e73b549d847 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:57:57.776444 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbf603-d31d-48f2-ab70-2e73b549d847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:57.777816 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbf603-d31d-48f2-ab70-2e73b549d847 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:57.782495 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 411/820] 10.222.0.98 () {56 vars in 1112 bytes} [Mon Jul 25 18:57:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:57:57.788833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf8678-c061-4688-9606-05aa48cb6def None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:57:57.885191 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf8678-c061-4688-9606-05aa48cb6def None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:57:57.886676 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:57:57.919587 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095e18d-2785-4425-bce0-463ae684a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:57:57.920232 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e18d-2785-4425-bce0-463ae684a107 None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:57:57.920519 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e18d-2785-4425-bce0-463ae684a107 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:57:57.920797 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e18d-2785-4425-bce0-463ae684a107 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:57:57.921535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095e18d-2785-4425-bce0-463ae684a107 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:57:57.922889 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095e18d-2785-4425-bce0-463ae684a107 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:57:57.941187 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 410/821] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 18:57:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:58:07.780161 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=96 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:58:07.937050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=20,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:58:59.633800 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30b18-3b42-439a-9f04-1a4fe098d641 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:58:59.634394 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30b18-3b42-439a-9f04-1a4fe098d641 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:58:59.634394 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30b18-3b42-439a-9f04-1a4fe098d641 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:58:59.635733 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 412/822] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:58:59.641224 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f75ce3-a302-4fa5-babb-d892f44daf37 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:58:59.641667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f75ce3-a302-4fa5-babb-d892f44daf37 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:58:59.641767 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f75ce3-a302-4fa5-babb-d892f44daf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:58:59.660706 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-25f75ce3-a302-4fa5-babb-d892f44daf37 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:58:59.663191 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-25f75ce3-a302-4fa5-babb-d892f44daf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:58:59.757064 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 411/823] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:58:59 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 18:58:59.785081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30b18-3b42-439a-9f04-1a4fe098d641 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:58:59.917064 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30b18-3b42-439a-9f04-1a4fe098d641 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:58:59.958923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fa852-59cc-41f7-bc78-b5fcde15aa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:58:59.959889 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fa852-59cc-41f7-bc78-b5fcde15aa52 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:58:59.960149 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fa852-59cc-41f7-bc78-b5fcde15aa52 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:58:59.960475 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fa852-59cc-41f7-bc78-b5fcde15aa52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:58:59.975152 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fa852-59cc-41f7-bc78-b5fcde15aa52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:58:59.975152 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fa852-59cc-41f7-bc78-b5fcde15aa52 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-693fa852-59cc-41f7-bc78-b5fcde15aa52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:58:59.996057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:58:59.997373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:58:59.998374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:58:59.998374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:58:59.998374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:58:59.998374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:58:59.998374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 413/824] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:59:00.003589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f75ce3-a302-4fa5-babb-d892f44daf37 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:00.130295 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f75ce3-a302-4fa5-babb-d892f44daf37 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:00.161136 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:00.171708 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee049d-21e9-49d4-af04-2c0574425fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:00.172321 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee049d-21e9-49d4-af04-2c0574425fe0 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:00.172639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee049d-21e9-49d4-af04-2c0574425fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:00.173004 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee049d-21e9-49d4-af04-2c0574425fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:00.173792 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee049d-21e9-49d4-af04-2c0574425fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:00.174107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee049d-21e9-49d4-af04-2c0574425fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:00.175507 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee049d-21e9-49d4-af04-2c0574425fe0 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:00.187902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 412/825] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:59:00.194522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fa852-59cc-41f7-bc78-b5fcde15aa52 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:00.258184 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:00.317146 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fa852-59cc-41f7-bc78-b5fcde15aa52 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:00.356412 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b27d88-04ba-4e13-a78e-254695e1e0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:00.357154 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b27d88-04ba-4e13-a78e-254695e1e0f7 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:00.357444 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b27d88-04ba-4e13-a78e-254695e1e0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:00.357766 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b27d88-04ba-4e13-a78e-254695e1e0f7 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:00.358496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b27d88-04ba-4e13-a78e-254695e1e0f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:00.360146 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b27d88-04ba-4e13-a78e-254695e1e0f7 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:00.391183 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 414/826] 10.222.0.98 () {60 vars in 1132 bytes} [Mon Jul 25 18:59:00 2022] POST /identity/v3/users => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:59:02.851806 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd4032-ff83-48aa-abb5-1ceb3320974f None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:02.852393 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd4032-ff83-48aa-abb5-1ceb3320974f None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:02.852491 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd4032-ff83-48aa-abb5-1ceb3320974f None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:02.854021 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 413/827] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 18:59:02.860086 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d0529-2230-438c-b8ab-1821d14c5ca5 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:02.860562 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d0529-2230-438c-b8ab-1821d14c5ca5 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:02.860665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d0529-2230-438c-b8ab-1821d14c5ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:02.881119 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-ec2d0529-2230-438c-b8ab-1821d14c5ca5 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:59:02.882302 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-ec2d0529-2230-438c-b8ab-1821d14c5ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:59:02.957649 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 415/828] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:59:02 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:59:02.985793 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd4032-ff83-48aa-abb5-1ceb3320974f None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:03.102745 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd4032-ff83-48aa-abb5-1ceb3320974f None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:03.143242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db3298-c697-4d68-a23b-129ce4da8b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:03.144106 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db3298-c697-4d68-a23b-129ce4da8b96 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:03.144355 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db3298-c697-4d68-a23b-129ce4da8b96 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:03.144694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db3298-c697-4d68-a23b-129ce4da8b96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:03.156304 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db3298-c697-4d68-a23b-129ce4da8b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-b5db3298-c697-4d68-a23b-129ce4da8b96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:59:03.164817 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:03.165823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:03.166774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 414/829] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:59:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:03.172832 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d0529-2230-438c-b8ab-1821d14c5ca5 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:03.219432 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:03.287072 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d0529-2230-438c-b8ab-1821d14c5ca5 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:03.327013 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d996cf-6fb9-4f02-a390-b089e5da1427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:03.327827 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d996cf-6fb9-4f02-a390-b089e5da1427 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:03.328193 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d996cf-6fb9-4f02-a390-b089e5da1427 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:03.328546 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d996cf-6fb9-4f02-a390-b089e5da1427 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:03.329395 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d996cf-6fb9-4f02-a390-b089e5da1427 None admin] RBAC: Adding query filter params (name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:03.329753 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d996cf-6fb9-4f02-a390-b089e5da1427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:03.331401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d996cf-6fb9-4f02-a390-b089e5da1427 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:03.341170 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 416/830] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:59:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:03.347008 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db3298-c697-4d68-a23b-129ce4da8b96 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:03.401569 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:03.457907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db3298-c697-4d68-a23b-129ce4da8b96 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:03.500839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146803-c9be-493a-90b2-6eb7eca2cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:03.501559 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146803-c9be-493a-90b2-6eb7eca2cf84 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:03.501842 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146803-c9be-493a-90b2-6eb7eca2cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:03.502121 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146803-c9be-493a-90b2-6eb7eca2cf84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:03.514387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f146803-c9be-493a-90b2-6eb7eca2cf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:03.515945 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f146803-c9be-493a-90b2-6eb7eca2cf84 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-3f146803-c9be-493a-90b2-6eb7eca2cf84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:03.537402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:03.538497 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:03.539471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:03.539471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:03.539471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:03.539471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:03.539471 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 415/831] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:59:03.544879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d996cf-6fb9-4f02-a390-b089e5da1427 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:03.659501 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:03.662980 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d996cf-6fb9-4f02-a390-b089e5da1427 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:03.707593 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8e4b1-7235-4c86-b882-add997c6d5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:03.709033 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e4b1-7235-4c86-b882-add997c6d5ee None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:03.711705 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e4b1-7235-4c86-b882-add997c6d5ee None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:03.711705 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e4b1-7235-4c86-b882-add997c6d5ee None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:03.711705 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8e4b1-7235-4c86-b882-add997c6d5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:03.711705 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8e4b1-7235-4c86-b882-add997c6d5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:03.712363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8e4b1-7235-4c86-b882-add997c6d5ee None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:03.726068 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 417/832] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:03.733388 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146803-c9be-493a-90b2-6eb7eca2cf84 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:03.843559 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:03.847392 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146803-c9be-493a-90b2-6eb7eca2cf84 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:03.885021 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aede61-7aac-4a71-8b48-2f60a2410be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:03.885828 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aede61-7aac-4a71-8b48-2f60a2410be9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:03.886109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aede61-7aac-4a71-8b48-2f60a2410be9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:03.886378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aede61-7aac-4a71-8b48-2f60a2410be9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:03.894544 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aede61-7aac-4a71-8b48-2f60a2410be9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:03.896662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aede61-7aac-4a71-8b48-2f60a2410be9 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-44aede61-7aac-4a71-8b48-2f60a2410be9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:59:03.913746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:03.914868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:03.915864 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 416/833] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:59:03.921102 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8e4b1-7235-4c86-b882-add997c6d5ee None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:04.029866 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8e4b1-7235-4c86-b882-add997c6d5ee None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:04.068161 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267c901-6f97-4c69-bd23-2323d2a43bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:04.068899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267c901-6f97-4c69-bd23-2323d2a43bce None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:04.069230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267c901-6f97-4c69-bd23-2323d2a43bce None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:04.069618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267c901-6f97-4c69-bd23-2323d2a43bce None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:04.070573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267c901-6f97-4c69-bd23-2323d2a43bce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:04.070887 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267c901-6f97-4c69-bd23-2323d2a43bce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:04.072573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267c901-6f97-4c69-bd23-2323d2a43bce None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:04.092732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 418/834] 10.222.0.98 () {56 vars in 1143 bytes} [Mon Jul 25 18:59:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:04.100021 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aede61-7aac-4a71-8b48-2f60a2410be9 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:04.216084 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aede61-7aac-4a71-8b48-2f60a2410be9 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:04.253032 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74b1f7-779e-41c7-9d0a-49bb5cbc23db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:04.253688 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74b1f7-779e-41c7-9d0a-49bb5cbc23db None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:04.253982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74b1f7-779e-41c7-9d0a-49bb5cbc23db None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:04.254262 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74b1f7-779e-41c7-9d0a-49bb5cbc23db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:04.283819 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:04.328734 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74b1f7-779e-41c7-9d0a-49bb5cbc23db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:04.330205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74b1f7-779e-41c7-9d0a-49bb5cbc23db None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:04.436648 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 417/835] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:59:04 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 18:59:04.443690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267c901-6f97-4c69-bd23-2323d2a43bce None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:04.467272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:04.553693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267c901-6f97-4c69-bd23-2323d2a43bce None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:04.589084 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de8d6c-f8b0-4b8e-b80c-a57d8f9168ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:04.589882 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de8d6c-f8b0-4b8e-b80c-a57d8f9168ec None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:04.590161 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de8d6c-f8b0-4b8e-b80c-a57d8f9168ec None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:04.590433 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de8d6c-f8b0-4b8e-b80c-a57d8f9168ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:04.601132 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de8d6c-f8b0-4b8e-b80c-a57d8f9168ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:04.602846 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de8d6c-f8b0-4b8e-b80c-a57d8f9168ec None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-67de8d6c-f8b0-4b8e-b80c-a57d8f9168ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:04.621652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:04.622795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:04.623770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:04.623770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:04.623770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:04.623770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:04.623770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 419/836] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:04.629270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74b1f7-779e-41c7-9d0a-49bb5cbc23db None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:04.697552 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:04.742309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74b1f7-779e-41c7-9d0a-49bb5cbc23db None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:04.779364 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892a72-aa72-48bc-9e62-0dab8b912446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:04.780035 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892a72-aa72-48bc-9e62-0dab8b912446 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:04.780321 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892a72-aa72-48bc-9e62-0dab8b912446 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:04.780600 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892a72-aa72-48bc-9e62-0dab8b912446 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:04.781353 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1892a72-aa72-48bc-9e62-0dab8b912446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:04.781629 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1892a72-aa72-48bc-9e62-0dab8b912446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:04.783002 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1892a72-aa72-48bc-9e62-0dab8b912446 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:04.795043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 418/837] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:59:04.800984 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de8d6c-f8b0-4b8e-b80c-a57d8f9168ec None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:04.879025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:04.917343 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de8d6c-f8b0-4b8e-b80c-a57d8f9168ec None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:04.954671 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eae96d-6967-4ddb-8481-e9bdff41e101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:04.955423 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae96d-6967-4ddb-8481-e9bdff41e101 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:04.955711 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae96d-6967-4ddb-8481-e9bdff41e101 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:04.956050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae96d-6967-4ddb-8481-e9bdff41e101 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:04.964027 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eae96d-6967-4ddb-8481-e9bdff41e101 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:04.965546 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eae96d-6967-4ddb-8481-e9bdff41e101 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-89eae96d-6967-4ddb-8481-e9bdff41e101 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:59:04.980276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:04.981447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:04.982363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:59:04.982363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:59:04.982363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:59:04.982363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:59:04.982363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:59:04.982363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:59:04.982363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:04.982363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:04.982363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 420/838] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:04.988075 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892a72-aa72-48bc-9e62-0dab8b912446 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:05.097436 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892a72-aa72-48bc-9e62-0dab8b912446 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:05.115399 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:05.133494 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e245167-28d7-4737-9062-acd160f87dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:05.134155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e245167-28d7-4737-9062-acd160f87dbe None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:05.134439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e245167-28d7-4737-9062-acd160f87dbe None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:05.134714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e245167-28d7-4737-9062-acd160f87dbe None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:05.135578 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e245167-28d7-4737-9062-acd160f87dbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:05.135892 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e245167-28d7-4737-9062-acd160f87dbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:05.137331 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e245167-28d7-4737-9062-acd160f87dbe None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:05.150203 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 419/839] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:05.156401 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eae96d-6967-4ddb-8481-e9bdff41e101 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:05.266908 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eae96d-6967-4ddb-8481-e9bdff41e101 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:05.298682 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:05.306253 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8a64-8199-4bba-a3a4-c58a944a6ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:05.307000 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8a64-8199-4bba-a3a4-c58a944a6ee5 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:05.307315 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8a64-8199-4bba-a3a4-c58a944a6ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:05.307653 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8a64-8199-4bba-a3a4-c58a944a6ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:05.308499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8a64-8199-4bba-a3a4-c58a944a6ee5 None admin] RBAC: Adding query filter params (role.id=3e9fca7423f14eb999603c531dfb03b4, scope.project.id=55faf272643648349c655751011854b8, user.id=679756d5f79e451bba682356d961883f) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:05.308859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8a64-8199-4bba-a3a4-c58a944a6ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:05.310433 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8a64-8199-4bba-a3a4-c58a944a6ee5 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:05.317663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 421/840] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:59:05 2022] GET /identity/v3/role_assignments?user.id=679756d5f79e451bba682356d961883f&scope.project.id=55faf272643648349c655751011854b8&role.id=3e9fca7423f14eb999603c531dfb03b4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:07.718302 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc71dd-99d0-435f-8e06-c246bf177361 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:07.718853 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc71dd-99d0-435f-8e06-c246bf177361 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:07.718853 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc71dd-99d0-435f-8e06-c246bf177361 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:07.720249 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 420/841] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:59:07.726279 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203eff1-af40-474d-9aac-e1d4af8b41b4 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:07.726713 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203eff1-af40-474d-9aac-e1d4af8b41b4 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:07.726847 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203eff1-af40-474d-9aac-e1d4af8b41b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:07.746094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-4203eff1-af40-474d-9aac-e1d4af8b41b4 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:59:07.747481 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-4203eff1-af40-474d-9aac-e1d4af8b41b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:59:07.817919 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 422/842] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:59:07 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:59:07.841970 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc71dd-99d0-435f-8e06-c246bf177361 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:07.951057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc71dd-99d0-435f-8e06-c246bf177361 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:07.989139 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272573dd-7846-48fc-a7e4-aec9de1f49a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:07.989930 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272573dd-7846-48fc-a7e4-aec9de1f49a0 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:07.990244 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272573dd-7846-48fc-a7e4-aec9de1f49a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:07.990486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272573dd-7846-48fc-a7e4-aec9de1f49a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:08.001032 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272573dd-7846-48fc-a7e4-aec9de1f49a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-272573dd-7846-48fc-a7e4-aec9de1f49a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:59:08.010378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:08.011801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:08.012912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 421/843] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:59:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:08.018377 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203eff1-af40-474d-9aac-e1d4af8b41b4 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:08.128374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203eff1-af40-474d-9aac-e1d4af8b41b4 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:08.156613 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:08.170365 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3aed7-b189-43ec-ad6c-06060d537da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:08.171428 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3aed7-b189-43ec-ad6c-06060d537da5 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:08.171778 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3aed7-b189-43ec-ad6c-06060d537da5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:08.172151 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3aed7-b189-43ec-ad6c-06060d537da5 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:08.173186 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3aed7-b189-43ec-ad6c-06060d537da5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:08.173720 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3aed7-b189-43ec-ad6c-06060d537da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:08.176320 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3aed7-b189-43ec-ad6c-06060d537da5 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:08.195756 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 423/844] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:59:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:08.197565 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272573dd-7846-48fc-a7e4-aec9de1f49a0 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:08.242252 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:08.311600 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272573dd-7846-48fc-a7e4-aec9de1f49a0 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:08.357924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b100d-08a8-4661-9936-a32081303fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:08.358968 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b100d-08a8-4661-9936-a32081303fcb None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:08.359286 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b100d-08a8-4661-9936-a32081303fcb None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:08.359598 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b100d-08a8-4661-9936-a32081303fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:08.370963 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b100d-08a8-4661-9936-a32081303fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:08.372451 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b100d-08a8-4661-9936-a32081303fcb None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-2c6b100d-08a8-4661-9936-a32081303fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:08.392781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:08.393875 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:08.395533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:08.395533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:08.395533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:08.395533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:08.395533 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 422/845] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:59:08.400431 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3aed7-b189-43ec-ad6c-06060d537da5 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:08.512705 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3aed7-b189-43ec-ad6c-06060d537da5 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:08.551706 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dadfef-a0eb-41d5-8c31-c6f220db2746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:08.552382 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dadfef-a0eb-41d5-8c31-c6f220db2746 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:08.552668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dadfef-a0eb-41d5-8c31-c6f220db2746 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:08.552945 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dadfef-a0eb-41d5-8c31-c6f220db2746 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:08.553668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dadfef-a0eb-41d5-8c31-c6f220db2746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:08.553979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dadfef-a0eb-41d5-8c31-c6f220db2746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:08.555390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dadfef-a0eb-41d5-8c31-c6f220db2746 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:08.572123 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 424/846] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:08.579215 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b100d-08a8-4661-9936-a32081303fcb None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:08.682906 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:08.694784 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b100d-08a8-4661-9936-a32081303fcb None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:08.733586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375707b3-eeac-4900-843d-db01216c7634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:08.734435 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375707b3-eeac-4900-843d-db01216c7634 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:08.734801 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375707b3-eeac-4900-843d-db01216c7634 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:08.735052 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375707b3-eeac-4900-843d-db01216c7634 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:08.744222 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375707b3-eeac-4900-843d-db01216c7634 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:08.745607 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375707b3-eeac-4900-843d-db01216c7634 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-375707b3-eeac-4900-843d-db01216c7634 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:59:08.761298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:08.762479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:08.763595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 423/847] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:08.768536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dadfef-a0eb-41d5-8c31-c6f220db2746 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:08.822280 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:08.877821 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dadfef-a0eb-41d5-8c31-c6f220db2746 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:08.915251 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd02d46-439b-4e4d-84d5-4745807e6313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:08.915927 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd02d46-439b-4e4d-84d5-4745807e6313 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:08.916210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd02d46-439b-4e4d-84d5-4745807e6313 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:08.916481 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd02d46-439b-4e4d-84d5-4745807e6313 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:08.917305 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd02d46-439b-4e4d-84d5-4745807e6313 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:08.917612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd02d46-439b-4e4d-84d5-4745807e6313 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:08.919101 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd02d46-439b-4e4d-84d5-4745807e6313 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:08.937367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 425/848] 10.222.0.98 () {56 vars in 1143 bytes} [Mon Jul 25 18:59:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:08.943742 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375707b3-eeac-4900-843d-db01216c7634 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:09.050455 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375707b3-eeac-4900-843d-db01216c7634 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:09.089251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e970b8c-f8a8-4587-94fd-57f2be7e1ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:09.090179 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e970b8c-f8a8-4587-94fd-57f2be7e1ac1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:09.090565 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e970b8c-f8a8-4587-94fd-57f2be7e1ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:09.090912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e970b8c-f8a8-4587-94fd-57f2be7e1ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:09.104076 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e970b8c-f8a8-4587-94fd-57f2be7e1ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:09.105541 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e970b8c-f8a8-4587-94fd-57f2be7e1ac1 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-6e970b8c-f8a8-4587-94fd-57f2be7e1ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:09.123639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:09.124856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:09.125958 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:09.125958 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:09.125958 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:09.125958 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:09.127121 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 424/849] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:09.134006 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd02d46-439b-4e4d-84d5-4745807e6313 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:09.240230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd02d46-439b-4e4d-84d5-4745807e6313 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:09.242583 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:09.276668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb55fb-cb57-4139-966b-609d6e432e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:09.277330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb55fb-cb57-4139-966b-609d6e432e99 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:09.277614 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb55fb-cb57-4139-966b-609d6e432e99 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:09.277889 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb55fb-cb57-4139-966b-609d6e432e99 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:09.278609 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb55fb-cb57-4139-966b-609d6e432e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:09.278910 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb55fb-cb57-4139-966b-609d6e432e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:09.280310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb55fb-cb57-4139-966b-609d6e432e99 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:09.292459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 426/850] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:09.298254 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e970b8c-f8a8-4587-94fd-57f2be7e1ac1 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:09.303184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:09.424167 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e970b8c-f8a8-4587-94fd-57f2be7e1ac1 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:09.460901 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543b1b9-9078-4b8f-b7d5-186f9556f798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:09.461674 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543b1b9-9078-4b8f-b7d5-186f9556f798 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:09.461953 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543b1b9-9078-4b8f-b7d5-186f9556f798 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:09.462224 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543b1b9-9078-4b8f-b7d5-186f9556f798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:09.468858 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543b1b9-9078-4b8f-b7d5-186f9556f798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:09.470283 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543b1b9-9078-4b8f-b7d5-186f9556f798 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-3543b1b9-9078-4b8f-b7d5-186f9556f798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:59:09.485324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:09.486387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:09.487490 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:59:09.487490 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:59:09.487490 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:59:09.487490 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:59:09.487490 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:59:09.487490 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:59:09.487490 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:09.487490 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:09.487490 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 425/851] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:09.493679 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb55fb-cb57-4139-966b-609d6e432e99 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:09.609035 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb55fb-cb57-4139-966b-609d6e432e99 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:09.647670 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a29440-7833-4d34-be41-64aa74eac7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:09.648486 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29440-7833-4d34-be41-64aa74eac7a8 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:09.648851 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29440-7833-4d34-be41-64aa74eac7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:09.649210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29440-7833-4d34-be41-64aa74eac7a8 None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:09.650179 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29440-7833-4d34-be41-64aa74eac7a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:09.650577 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29440-7833-4d34-be41-64aa74eac7a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:09.652394 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29440-7833-4d34-be41-64aa74eac7a8 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:09.666941 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 427/852] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:59:09.672780 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543b1b9-9078-4b8f-b7d5-186f9556f798 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:09.743370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:09.788736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543b1b9-9078-4b8f-b7d5-186f9556f798 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:09.827109 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f8cb6-9403-49db-bed9-1cc52c063c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:09.828050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f8cb6-9403-49db-bed9-1cc52c063c93 None admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:09.828318 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f8cb6-9403-49db-bed9-1cc52c063c93 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:09.828608 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f8cb6-9403-49db-bed9-1cc52c063c93 None admin] PATH_INFO: `/v3/projects/55faf272643648349c655751011854b8/users/679756d5f79e451bba682356d961883f/roles/3e9fca7423f14eb999603c531dfb03b4` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:09.844125 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f8cb6-9403-49db-bed9-1cc52c063c93 None admin] RBAC: Authorizing `identity:create_grant(project_id=55faf272643648349c655751011854b8, user_id=679756d5f79e451bba682356d961883f, role_id=3e9fca7423f14eb999603c531dfb03b4)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:09.845595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f8cb6-9403-49db-bed9-1cc52c063c93 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:09.858982 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 426/853] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:59:09 2022] PUT /identity/v3/projects/55faf272643648349c655751011854b8/users/679756d5f79e451bba682356d961883f/roles/3e9fca7423f14eb999603c531dfb03b4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:59:12.093062 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8d312-b9a3-4208-bb69-1b0353567907 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:12.093594 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8d312-b9a3-4208-bb69-1b0353567907 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:12.093594 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8d312-b9a3-4208-bb69-1b0353567907 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:12.095047 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 428/854] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:59:12.100784 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caad293-950c-4d1b-9f00-abc421906f23 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:12.101236 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caad293-950c-4d1b-9f00-abc421906f23 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:12.101337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caad293-950c-4d1b-9f00-abc421906f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:12.120362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-6caad293-950c-4d1b-9f00-abc421906f23 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:59:12.121618 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-6caad293-950c-4d1b-9f00-abc421906f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:59:12.200298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 427/855] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:59:12 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:59:12.227153 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8d312-b9a3-4208-bb69-1b0353567907 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:12.255219 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:12.337651 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8d312-b9a3-4208-bb69-1b0353567907 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:12.378488 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4d26-d38b-498f-840e-ecc9a9728d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:12.380164 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4d26-d38b-498f-840e-ecc9a9728d82 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:12.380508 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4d26-d38b-498f-840e-ecc9a9728d82 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:12.380713 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4d26-d38b-498f-840e-ecc9a9728d82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:12.391420 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b4d26-d38b-498f-840e-ecc9a9728d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-fc8b4d26-d38b-498f-840e-ecc9a9728d82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:59:12.399872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:12.401085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:12.402096 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 429/856] 10.222.0.98 () {56 vars in 1102 bytes} [Mon Jul 25 18:59:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:12.407314 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caad293-950c-4d1b-9f00-abc421906f23 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:12.452169 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:12.516386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caad293-950c-4d1b-9f00-abc421906f23 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:12.556900 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c247a-637a-45cd-b8cd-c4786986cc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:12.557718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c247a-637a-45cd-b8cd-c4786986cc2b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:12.558045 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c247a-637a-45cd-b8cd-c4786986cc2b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:12.558392 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c247a-637a-45cd-b8cd-c4786986cc2b None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:12.559192 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c247a-637a-45cd-b8cd-c4786986cc2b None admin] RBAC: Adding query filter params (name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:12.559485 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c247a-637a-45cd-b8cd-c4786986cc2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:12.560869 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c247a-637a-45cd-b8cd-c4786986cc2b None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:12.570716 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 428/857] 10.222.0.98 () {56 vars in 1103 bytes} [Mon Jul 25 18:59:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:59:12.576898 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4d26-d38b-498f-840e-ecc9a9728d82 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:12.685834 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:12.704211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4d26-d38b-498f-840e-ecc9a9728d82 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:12.743149 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af78cb1-9753-4e52-81cf-b8ed8c7ec3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:12.744243 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af78cb1-9753-4e52-81cf-b8ed8c7ec3e3 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:12.744707 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af78cb1-9753-4e52-81cf-b8ed8c7ec3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:12.745012 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af78cb1-9753-4e52-81cf-b8ed8c7ec3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:12.758697 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af78cb1-9753-4e52-81cf-b8ed8c7ec3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:12.760337 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af78cb1-9753-4e52-81cf-b8ed8c7ec3e3 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-8af78cb1-9753-4e52-81cf-b8ed8c7ec3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:12.781171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:12.782284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:12.783245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:12.783245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:12.783245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:12.783245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:12.783245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 430/858] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:12.788910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c247a-637a-45cd-b8cd-c4786986cc2b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:12.916650 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c247a-637a-45cd-b8cd-c4786986cc2b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:12.919515 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:12.954941 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9850d8-013c-4737-9a35-6f5b6a0e7373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:12.955655 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9850d8-013c-4737-9a35-6f5b6a0e7373 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:12.955940 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9850d8-013c-4737-9a35-6f5b6a0e7373 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:12.956218 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9850d8-013c-4737-9a35-6f5b6a0e7373 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:12.956940 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9850d8-013c-4737-9a35-6f5b6a0e7373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:12.958005 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9850d8-013c-4737-9a35-6f5b6a0e7373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:12.959931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9850d8-013c-4737-9a35-6f5b6a0e7373 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:12.972108 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 429/859] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:59:12.981849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af78cb1-9753-4e52-81cf-b8ed8c7ec3e3 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:13.100754 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af78cb1-9753-4e52-81cf-b8ed8c7ec3e3 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:13.143940 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521d0cc-a266-4bba-873d-1be4e78111bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:13.144769 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521d0cc-a266-4bba-873d-1be4e78111bc None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:13.145327 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521d0cc-a266-4bba-873d-1be4e78111bc None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:13.145646 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521d0cc-a266-4bba-873d-1be4e78111bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:13.148712 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:13.155215 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521d0cc-a266-4bba-873d-1be4e78111bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:13.157137 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521d0cc-a266-4bba-873d-1be4e78111bc None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-4521d0cc-a266-4bba-873d-1be4e78111bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:59:13.174090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:13.175430 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:13.180267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 431/860] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:13.182890 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9850d8-013c-4737-9a35-6f5b6a0e7373 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:13.296410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9850d8-013c-4737-9a35-6f5b6a0e7373 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:13.339205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e8642-2770-4243-9025-9defef1e9b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:13.340050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8642-2770-4243-9025-9defef1e9b7f None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:13.340341 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8642-2770-4243-9025-9defef1e9b7f None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:13.340626 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8642-2770-4243-9025-9defef1e9b7f None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:13.341479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e8642-2770-4243-9025-9defef1e9b7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:13.341774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e8642-2770-4243-9025-9defef1e9b7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:13.343293 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e8642-2770-4243-9025-9defef1e9b7f None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:13.361804 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 430/861] 10.222.0.98 () {56 vars in 1143 bytes} [Mon Jul 25 18:59:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:13.369349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521d0cc-a266-4bba-873d-1be4e78111bc None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:13.487812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521d0cc-a266-4bba-873d-1be4e78111bc None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:13.523233 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ede77c-c06a-4543-bbda-c076e8a2eac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:13.523991 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ede77c-c06a-4543-bbda-c076e8a2eac6 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:13.524338 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ede77c-c06a-4543-bbda-c076e8a2eac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:13.524733 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ede77c-c06a-4543-bbda-c076e8a2eac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:13.596496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:13.606381 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ede77c-c06a-4543-bbda-c076e8a2eac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:13.608935 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ede77c-c06a-4543-bbda-c076e8a2eac6 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:13.732185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 432/862] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:59:13 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 18:59:13.738675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e8642-2770-4243-9025-9defef1e9b7f None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:13.765396 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:13.856695 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e8642-2770-4243-9025-9defef1e9b7f None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:13.895262 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a88730-eb0f-4d4c-8334-a1a70e46f7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:13.896214 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88730-eb0f-4d4c-8334-a1a70e46f7c5 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:13.896502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88730-eb0f-4d4c-8334-a1a70e46f7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:13.896784 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88730-eb0f-4d4c-8334-a1a70e46f7c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:13.908430 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a88730-eb0f-4d4c-8334-a1a70e46f7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:13.909887 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a88730-eb0f-4d4c-8334-a1a70e46f7c5 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-37a88730-eb0f-4d4c-8334-a1a70e46f7c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:13.932171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:13.933210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:13.934186 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:13.934186 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:13.934186 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:13.934186 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:13.934186 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 431/863] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:13.939880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ede77c-c06a-4543-bbda-c076e8a2eac6 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:14.048889 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:14.055348 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ede77c-c06a-4543-bbda-c076e8a2eac6 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:14.096782 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8ec0b-e6ab-4b2f-93d5-4398b2485b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:14.097635 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8ec0b-e6ab-4b2f-93d5-4398b2485b18 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:14.098167 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8ec0b-e6ab-4b2f-93d5-4398b2485b18 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:14.098539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8ec0b-e6ab-4b2f-93d5-4398b2485b18 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:14.099328 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8ec0b-e6ab-4b2f-93d5-4398b2485b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:14.099640 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8ec0b-e6ab-4b2f-93d5-4398b2485b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:14.101031 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8ec0b-e6ab-4b2f-93d5-4398b2485b18 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:14.114260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 433/864] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:14.119948 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a88730-eb0f-4d4c-8334-a1a70e46f7c5 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:14.202314 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:14.230752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a88730-eb0f-4d4c-8334-a1a70e46f7c5 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:14.268927 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853874-dc03-401c-ab9e-759e275f74c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:14.270294 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853874-dc03-401c-ab9e-759e275f74c2 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:14.270662 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853874-dc03-401c-ab9e-759e275f74c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:14.271107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853874-dc03-401c-ab9e-759e275f74c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:14.278554 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5853874-dc03-401c-ab9e-759e275f74c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:14.280126 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5853874-dc03-401c-ab9e-759e275f74c2 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-f5853874-dc03-401c-ab9e-759e275f74c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:59:14.294832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:14.296025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:14.296909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:59:14.296909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:59:14.296909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:59:14.296909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:59:14.296909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:59:14.296909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:59:14.296909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:14.296909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:14.296909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 432/865] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 18:59:14.302496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8ec0b-e6ab-4b2f-93d5-4398b2485b18 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:14.422396 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8ec0b-e6ab-4b2f-93d5-4398b2485b18 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:14.461450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46e45d-f800-41c3-b894-23fb84398353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:14.462147 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46e45d-f800-41c3-b894-23fb84398353 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:14.462457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46e45d-f800-41c3-b894-23fb84398353 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:14.462758 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46e45d-f800-41c3-b894-23fb84398353 None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:14.463682 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46e45d-f800-41c3-b894-23fb84398353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:14.463995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46e45d-f800-41c3-b894-23fb84398353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:14.465590 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46e45d-f800-41c3-b894-23fb84398353 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:14.479872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 434/866] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:59:14.486313 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853874-dc03-401c-ab9e-759e275f74c2 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:14.601587 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853874-dc03-401c-ab9e-759e275f74c2 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:14.644327 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a375d-ae88-48f5-a60c-81c423118a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:14.644973 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a375d-ae88-48f5-a60c-81c423118a1e None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:14.645310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a375d-ae88-48f5-a60c-81c423118a1e None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:14.645585 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a375d-ae88-48f5-a60c-81c423118a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:14.646514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a375d-ae88-48f5-a60c-81c423118a1e None admin] RBAC: Adding query filter params (role.id=3e9fca7423f14eb999603c531dfb03b4, scope.project.id=55faf272643648349c655751011854b8, user.id=679756d5f79e451bba682356d961883f) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:14.646803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a375d-ae88-48f5-a60c-81c423118a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:14.648412 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a375d-ae88-48f5-a60c-81c423118a1e None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:14.650447 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:14.656039 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 433/867] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:59:14 2022] GET /identity/v3/role_assignments?user.id=679756d5f79e451bba682356d961883f&scope.project.id=55faf272643648349c655751011854b8&role.id=3e9fca7423f14eb999603c531dfb03b4 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:17.084465 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223df8a-4ad1-42e0-8005-ba472156779d None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:17.084986 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223df8a-4ad1-42e0-8005-ba472156779d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:17.085188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223df8a-4ad1-42e0-8005-ba472156779d None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:17.086821 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 435/868] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:59:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:59:17.093169 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733671b-3e69-4851-918a-b10ce6a17f20 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:17.093622 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733671b-3e69-4851-918a-b10ce6a17f20 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:17.093881 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733671b-3e69-4851-918a-b10ce6a17f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:17.118994 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-c733671b-3e69-4851-918a-b10ce6a17f20 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:59:17.120435 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-c733671b-3e69-4851-918a-b10ce6a17f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:59:17.199184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 434/869] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:59:17 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:59:17.228671 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223df8a-4ad1-42e0-8005-ba472156779d None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:17.251070 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:17.373938 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223df8a-4ad1-42e0-8005-ba472156779d None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:17.424215 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02496c55-be6f-4850-9b0f-9de4c1fb4add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:17.425013 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02496c55-be6f-4850-9b0f-9de4c1fb4add None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:17.425299 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02496c55-be6f-4850-9b0f-9de4c1fb4add None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:17.425573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02496c55-be6f-4850-9b0f-9de4c1fb4add None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:17.440270 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02496c55-be6f-4850-9b0f-9de4c1fb4add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-02496c55-be6f-4850-9b0f-9de4c1fb4add None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:59:17.450982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:17.452295 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:17.453189 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 436/870] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:17.460349 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733671b-3e69-4851-918a-b10ce6a17f20 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:17.590317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733671b-3e69-4851-918a-b10ce6a17f20 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:17.621413 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:17.631396 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f4a3d-746b-496b-841d-15575cbb3073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:17.632009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f4a3d-746b-496b-841d-15575cbb3073 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:17.632293 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f4a3d-746b-496b-841d-15575cbb3073 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:17.632571 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f4a3d-746b-496b-841d-15575cbb3073 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:17.633355 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f4a3d-746b-496b-841d-15575cbb3073 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:17.633667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f4a3d-746b-496b-841d-15575cbb3073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:17.635036 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f4a3d-746b-496b-841d-15575cbb3073 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:17.643479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 435/871] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:59:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:17.649772 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02496c55-be6f-4850-9b0f-9de4c1fb4add None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:17.752601 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:17.780022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02496c55-be6f-4850-9b0f-9de4c1fb4add None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:17.820191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16a4ba-1927-4147-a5ff-7007bb52b7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:17.821132 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16a4ba-1927-4147-a5ff-7007bb52b7a0 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:17.821424 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16a4ba-1927-4147-a5ff-7007bb52b7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:17.821718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16a4ba-1927-4147-a5ff-7007bb52b7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:17.834670 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16a4ba-1927-4147-a5ff-7007bb52b7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:17.836104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16a4ba-1927-4147-a5ff-7007bb52b7a0 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-af16a4ba-1927-4147-a5ff-7007bb52b7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:17.854746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:17.855777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:17.858890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:17.858890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:17.858890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:17.858890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:17.858890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 437/872] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:17.861857 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f4a3d-746b-496b-841d-15575cbb3073 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:17.976139 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f4a3d-746b-496b-841d-15575cbb3073 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:18.012986 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e9ea4-a137-4bcb-9fd2-cff488bea50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:18.013659 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e9ea4-a137-4bcb-9fd2-cff488bea50a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:18.013954 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e9ea4-a137-4bcb-9fd2-cff488bea50a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:18.014235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e9ea4-a137-4bcb-9fd2-cff488bea50a None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:18.014958 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e9ea4-a137-4bcb-9fd2-cff488bea50a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:18.015307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e9ea4-a137-4bcb-9fd2-cff488bea50a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:18.016670 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e9ea4-a137-4bcb-9fd2-cff488bea50a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:18.029202 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 436/873] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:18.035902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16a4ba-1927-4147-a5ff-7007bb52b7a0 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:18.149328 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16a4ba-1927-4147-a5ff-7007bb52b7a0 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:18.177247 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:18.185402 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214b542-1200-4f28-81ee-52d96c441482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:18.186205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214b542-1200-4f28-81ee-52d96c441482 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:18.186492 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214b542-1200-4f28-81ee-52d96c441482 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:18.186767 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214b542-1200-4f28-81ee-52d96c441482 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:18.196488 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214b542-1200-4f28-81ee-52d96c441482 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:18.197960 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214b542-1200-4f28-81ee-52d96c441482 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-c214b542-1200-4f28-81ee-52d96c441482 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:59:18.214202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:18.215264 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:18.216238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 438/874] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:18.223866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e9ea4-a137-4bcb-9fd2-cff488bea50a None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:18.277721 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:18.336894 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e9ea4-a137-4bcb-9fd2-cff488bea50a None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:18.380668 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9401229-a2b2-4639-bb1b-b762005da382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:18.381339 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9401229-a2b2-4639-bb1b-b762005da382 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:18.381624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9401229-a2b2-4639-bb1b-b762005da382 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:18.381996 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9401229-a2b2-4639-bb1b-b762005da382 None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:18.383545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9401229-a2b2-4639-bb1b-b762005da382 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:18.384019 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9401229-a2b2-4639-bb1b-b762005da382 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:18.385825 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9401229-a2b2-4639-bb1b-b762005da382 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:18.409630 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 437/875] 10.222.0.98 () {56 vars in 1143 bytes} [Mon Jul 25 18:59:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:18.416304 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214b542-1200-4f28-81ee-52d96c441482 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:18.536415 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214b542-1200-4f28-81ee-52d96c441482 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:18.573432 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac2d1e-b16e-4790-8d0c-eee6ed9595c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:18.574363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2d1e-b16e-4790-8d0c-eee6ed9595c2 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:18.574659 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2d1e-b16e-4790-8d0c-eee6ed9595c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:18.574978 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2d1e-b16e-4790-8d0c-eee6ed9595c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:18.641452 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:18.656370 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac2d1e-b16e-4790-8d0c-eee6ed9595c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:18.657849 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac2d1e-b16e-4790-8d0c-eee6ed9595c2 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:18.772081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 439/876] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:59:18 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 18:59:18.778120 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9401229-a2b2-4639-bb1b-b762005da382 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:18.886425 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9401229-a2b2-4639-bb1b-b762005da382 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:18.897746 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:18.927574 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0041f5-9a6b-4684-8485-6be9708582cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:18.928389 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0041f5-9a6b-4684-8485-6be9708582cb None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:18.928669 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0041f5-9a6b-4684-8485-6be9708582cb None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:18.928941 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0041f5-9a6b-4684-8485-6be9708582cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:18.942648 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0041f5-9a6b-4684-8485-6be9708582cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:18.944153 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0041f5-9a6b-4684-8485-6be9708582cb None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-0c0041f5-9a6b-4684-8485-6be9708582cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:18.964107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:18.965281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:18.966297 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:18.966297 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:18.966297 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:18.966297 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:18.966297 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 438/877] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:18.972272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac2d1e-b16e-4790-8d0c-eee6ed9595c2 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:19.068248 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:19.081262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac2d1e-b16e-4790-8d0c-eee6ed9595c2 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:19.117031 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855fb50-84af-4b54-a2fa-d27f872a7afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:19.117714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855fb50-84af-4b54-a2fa-d27f872a7afc None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:19.117995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855fb50-84af-4b54-a2fa-d27f872a7afc None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:19.118267 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855fb50-84af-4b54-a2fa-d27f872a7afc None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:19.119006 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855fb50-84af-4b54-a2fa-d27f872a7afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:19.119348 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855fb50-84af-4b54-a2fa-d27f872a7afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:19.120749 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855fb50-84af-4b54-a2fa-d27f872a7afc None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:19.134181 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 440/878] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:59:19.140108 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0041f5-9a6b-4684-8485-6be9708582cb None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:19.245776 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0041f5-9a6b-4684-8485-6be9708582cb None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:19.280620 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20636da-9a19-49c5-9227-b5584230c149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:19.281410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20636da-9a19-49c5-9227-b5584230c149 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:19.281693 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20636da-9a19-49c5-9227-b5584230c149 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:19.281975 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20636da-9a19-49c5-9227-b5584230c149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:19.289318 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20636da-9a19-49c5-9227-b5584230c149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:19.290757 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20636da-9a19-49c5-9227-b5584230c149 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-d20636da-9a19-49c5-9227-b5584230c149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:59:19.305132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:19.306337 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:19.307317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:59:19.307317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:59:19.307317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:59:19.307317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:59:19.307317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:59:19.307317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:59:19.307317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:19.307317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:19.307317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 439/879] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:19.313804 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855fb50-84af-4b54-a2fa-d27f872a7afc None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:19.429834 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855fb50-84af-4b54-a2fa-d27f872a7afc None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:19.465020 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2a2dd-f2bf-4019-adbe-505312e6ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:19.465679 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2a2dd-f2bf-4019-adbe-505312e6ec58 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:19.465964 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2a2dd-f2bf-4019-adbe-505312e6ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:19.466238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2a2dd-f2bf-4019-adbe-505312e6ec58 None admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:19.467024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2a2dd-f2bf-4019-adbe-505312e6ec58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:19.467527 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2a2dd-f2bf-4019-adbe-505312e6ec58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:19.468969 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2a2dd-f2bf-4019-adbe-505312e6ec58 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:19.481233 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 441/880] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:19.487470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20636da-9a19-49c5-9227-b5584230c149 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:19.510803 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:19.587733 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20636da-9a19-49c5-9227-b5584230c149 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:19.620827 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfcb44-cf1a-4d19-8c32-d4cbff6c6d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:19.621472 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfcb44-cf1a-4d19-8c32-d4cbff6c6d35 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:19.621759 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfcb44-cf1a-4d19-8c32-d4cbff6c6d35 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:19.622035 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfcb44-cf1a-4d19-8c32-d4cbff6c6d35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:19.622853 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfcb44-cf1a-4d19-8c32-d4cbff6c6d35 None admin] RBAC: Adding query filter params (role.id=472a286d91bd484a83e2de07fc231c06, scope.project.id=55faf272643648349c655751011854b8, user.id=679756d5f79e451bba682356d961883f) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:19.623211 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfcb44-cf1a-4d19-8c32-d4cbff6c6d35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:19.624631 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfcb44-cf1a-4d19-8c32-d4cbff6c6d35 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:19.630454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 440/881] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:59:19 2022] GET /identity/v3/role_assignments?user.id=679756d5f79e451bba682356d961883f&scope.project.id=55faf272643648349c655751011854b8&role.id=472a286d91bd484a83e2de07fc231c06 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:21.961029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644652ac-c80c-4513-a00a-4bcf80fa3522 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:21.961580 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644652ac-c80c-4513-a00a-4bcf80fa3522 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:21.961580 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644652ac-c80c-4513-a00a-4bcf80fa3522 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:21.962952 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 442/882] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:59:21.968146 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c2c0-c8df-4a4e-9aea-33b35591acce None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:21.968560 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c2c0-c8df-4a4e-9aea-33b35591acce None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:21.968702 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c2c0-c8df-4a4e-9aea-33b35591acce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:21.986842 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-6131c2c0-c8df-4a4e-9aea-33b35591acce None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:59:21.988092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-6131c2c0-c8df-4a4e-9aea-33b35591acce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:59:22.057305 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 441/883] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:59:21 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:59:22.081342 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644652ac-c80c-4513-a00a-4bcf80fa3522 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:22.092188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:22.182367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644652ac-c80c-4513-a00a-4bcf80fa3522 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:22.215589 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43987a-4920-41fc-9578-080644404378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:22.216312 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43987a-4920-41fc-9578-080644404378 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:22.216599 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43987a-4920-41fc-9578-080644404378 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:22.216879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43987a-4920-41fc-9578-080644404378 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:22.227358 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43987a-4920-41fc-9578-080644404378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-af43987a-4920-41fc-9578-080644404378 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:59:22.235029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:22.236134 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:22.237015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 443/884] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:22.242871 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c2c0-c8df-4a4e-9aea-33b35591acce None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:22.257898 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:22.346664 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c2c0-c8df-4a4e-9aea-33b35591acce None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:22.384547 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9651974-fee0-4079-9e26-89dfdbddfa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:22.385215 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651974-fee0-4079-9e26-89dfdbddfa97 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:22.385502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651974-fee0-4079-9e26-89dfdbddfa97 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:22.385778 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651974-fee0-4079-9e26-89dfdbddfa97 None admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:22.386519 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9651974-fee0-4079-9e26-89dfdbddfa97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:22.386827 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9651974-fee0-4079-9e26-89dfdbddfa97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:22.388223 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9651974-fee0-4079-9e26-89dfdbddfa97 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:22.396642 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 442/885] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:22.402327 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43987a-4920-41fc-9578-080644404378 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:22.466776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:22.501139 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43987a-4920-41fc-9578-080644404378 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:22.534239 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ce85d-8a5a-4f4b-806a-cd852e097d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:22.535011 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ce85d-8a5a-4f4b-806a-cd852e097d6c None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:22.535324 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ce85d-8a5a-4f4b-806a-cd852e097d6c None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:22.535597 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ce85d-8a5a-4f4b-806a-cd852e097d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:22.545718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ce85d-8a5a-4f4b-806a-cd852e097d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:22.547205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ce85d-8a5a-4f4b-806a-cd852e097d6c None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-d29ce85d-8a5a-4f4b-806a-cd852e097d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:22.564238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:22.565293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:22.566421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:22.566421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:22.566421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:22.566421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:22.566421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 444/886] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:22.571683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9651974-fee0-4079-9e26-89dfdbddfa97 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:22.646983 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:22.669196 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9651974-fee0-4079-9e26-89dfdbddfa97 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:22.704627 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317bdc-bb25-4cd0-8859-a82000a19beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:22.705297 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317bdc-bb25-4cd0-8859-a82000a19beb None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:22.705588 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317bdc-bb25-4cd0-8859-a82000a19beb None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:22.705870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317bdc-bb25-4cd0-8859-a82000a19beb None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:22.706587 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317bdc-bb25-4cd0-8859-a82000a19beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:22.706900 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317bdc-bb25-4cd0-8859-a82000a19beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:22.708325 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317bdc-bb25-4cd0-8859-a82000a19beb None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:22.720107 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 443/887] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:22.725655 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ce85d-8a5a-4f4b-806a-cd852e097d6c None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:22.826389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ce85d-8a5a-4f4b-806a-cd852e097d6c None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:22.845548 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:22.859434 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8052bc-2260-43e5-aa5c-414c14359074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:22.860224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8052bc-2260-43e5-aa5c-414c14359074 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:22.860507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8052bc-2260-43e5-aa5c-414c14359074 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:22.860779 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8052bc-2260-43e5-aa5c-414c14359074 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:22.868661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8052bc-2260-43e5-aa5c-414c14359074 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:22.870099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8052bc-2260-43e5-aa5c-414c14359074 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-bc8052bc-2260-43e5-aa5c-414c14359074 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:59:22.884762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:22.885837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:22.886803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 445/888] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:22.891759 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317bdc-bb25-4cd0-8859-a82000a19beb None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:22.991627 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317bdc-bb25-4cd0-8859-a82000a19beb None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:23.025553 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdf368-7907-449f-a5b6-d34b3fdc1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:23.026219 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdf368-7907-449f-a5b6-d34b3fdc1ccd None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:23.026504 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdf368-7907-449f-a5b6-d34b3fdc1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:23.026781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdf368-7907-449f-a5b6-d34b3fdc1ccd None admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:23.027643 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdf368-7907-449f-a5b6-d34b3fdc1ccd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:23.027956 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdf368-7907-449f-a5b6-d34b3fdc1ccd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:23.029375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdf368-7907-449f-a5b6-d34b3fdc1ccd None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:23.031913 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:23.047273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 444/889] 10.222.0.98 () {56 vars in 1143 bytes} [Mon Jul 25 18:59:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:23.053634 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8052bc-2260-43e5-aa5c-414c14359074 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:23.151482 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8052bc-2260-43e5-aa5c-414c14359074 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:23.184618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c71dd-c699-454e-aab8-317b2191f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:23.185405 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c71dd-c699-454e-aab8-317b2191f820 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:23.185688 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c71dd-c699-454e-aab8-317b2191f820 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:23.185961 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c71dd-c699-454e-aab8-317b2191f820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:23.196127 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c71dd-c699-454e-aab8-317b2191f820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:23.197561 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c71dd-c699-454e-aab8-317b2191f820 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-0a2c71dd-c699-454e-aab8-317b2191f820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:23.214050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:23.215085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:23.216224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:23.216224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:23.216224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:23.216224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:23.216224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 446/890] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:23.220863 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdf368-7907-449f-a5b6-d34b3fdc1ccd None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:23.322892 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdf368-7907-449f-a5b6-d34b3fdc1ccd None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:23.359472 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e585-593b-4648-827b-96e53064861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:23.360175 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e585-593b-4648-827b-96e53064861d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:23.360461 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e585-593b-4648-827b-96e53064861d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:23.360736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928e585-593b-4648-827b-96e53064861d None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:23.361444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e585-593b-4648-827b-96e53064861d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:23.361751 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e585-593b-4648-827b-96e53064861d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:23.363110 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928e585-593b-4648-827b-96e53064861d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:23.374303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 445/891] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:23.380642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c71dd-c699-454e-aab8-317b2191f820 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:23.413033 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:23.479775 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c71dd-c699-454e-aab8-317b2191f820 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:23.512407 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b1b7e-566e-4294-bcdb-10ff11f4c88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:23.513178 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b1b7e-566e-4294-bcdb-10ff11f4c88a None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:23.513459 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b1b7e-566e-4294-bcdb-10ff11f4c88a None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:23.513730 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b1b7e-566e-4294-bcdb-10ff11f4c88a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:23.520117 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b1b7e-566e-4294-bcdb-10ff11f4c88a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:23.522564 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b1b7e-566e-4294-bcdb-10ff11f4c88a None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-fd7b1b7e-566e-4294-bcdb-10ff11f4c88a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:59:23.538536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:23.539463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:23.540399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:59:23.540399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:59:23.540399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:59:23.540399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:59:23.540399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:59:23.540399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:59:23.540399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:23.540399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:23.540399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 447/892] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:23.545535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e585-593b-4648-827b-96e53064861d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:23.601518 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:23.646895 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928e585-593b-4648-827b-96e53064861d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:23.679345 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee43124-e375-4c8a-8cf8-3c642ee55f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:23.680006 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee43124-e375-4c8a-8cf8-3c642ee55f70 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:23.680292 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee43124-e375-4c8a-8cf8-3c642ee55f70 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:23.680569 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee43124-e375-4c8a-8cf8-3c642ee55f70 None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:23.681354 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee43124-e375-4c8a-8cf8-3c642ee55f70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:23.681666 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee43124-e375-4c8a-8cf8-3c642ee55f70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:23.683085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee43124-e375-4c8a-8cf8-3c642ee55f70 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:23.696507 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 446/893] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:23.702395 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b1b7e-566e-4294-bcdb-10ff11f4c88a None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:23.793017 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:23.802463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b1b7e-566e-4294-bcdb-10ff11f4c88a None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:23.836995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67f917-1aae-4ba2-a53c-c570e19a8d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:23.837899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f917-1aae-4ba2-a53c-c570e19a8d81 None admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:23.838182 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f917-1aae-4ba2-a53c-c570e19a8d81 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:23.838458 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f917-1aae-4ba2-a53c-c570e19a8d81 None admin] PATH_INFO: `/v3/projects/55faf272643648349c655751011854b8/users/679756d5f79e451bba682356d961883f/roles/472a286d91bd484a83e2de07fc231c06` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:23.840414 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67f917-1aae-4ba2-a53c-c570e19a8d81 None admin] RBAC: Authorizing `identity:create_grant(project_id=55faf272643648349c655751011854b8, user_id=679756d5f79e451bba682356d961883f, role_id=472a286d91bd484a83e2de07fc231c06)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:23.841907 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67f917-1aae-4ba2-a53c-c570e19a8d81 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:23.854256 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 448/894] 10.222.0.98 () {58 vars in 1439 bytes} [Mon Jul 25 18:59:23 2022] PUT /identity/v3/projects/55faf272643648349c655751011854b8/users/679756d5f79e451bba682356d961883f/roles/472a286d91bd484a83e2de07fc231c06 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 18:59:26.276454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225d56b-4634-4a7e-96b1-3fb5ce0f29a5 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:26.277005 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225d56b-4634-4a7e-96b1-3fb5ce0f29a5 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:26.277005 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225d56b-4634-4a7e-96b1-3fb5ce0f29a5 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:26.278372 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 447/895] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:59:26.283377 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbb4de-da73-4602-9bf1-fe996524bc9a None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:26.283765 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbb4de-da73-4602-9bf1-fe996524bc9a None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:26.283936 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbb4de-da73-4602-9bf1-fe996524bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:26.303158 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-e7bbb4de-da73-4602-9bf1-fe996524bc9a None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:59:26.304437 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-e7bbb4de-da73-4602-9bf1-fe996524bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:59:26.377352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 449/896] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:59:26 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:59:26.402981 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225d56b-4634-4a7e-96b1-3fb5ce0f29a5 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:26.503094 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225d56b-4634-4a7e-96b1-3fb5ce0f29a5 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:26.518551 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:26.538469 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21b683-3a9f-4b57-a6f4-8e302fcc2d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:26.539205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b683-3a9f-4b57-a6f4-8e302fcc2d3b None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:26.539489 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b683-3a9f-4b57-a6f4-8e302fcc2d3b None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:26.539764 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b683-3a9f-4b57-a6f4-8e302fcc2d3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:26.549509 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21b683-3a9f-4b57-a6f4-8e302fcc2d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-ad21b683-3a9f-4b57-a6f4-8e302fcc2d3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 18:59:26.557997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:26.559113 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:26.560291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 448/897] 10.222.0.98 () {56 vars in 1096 bytes} [Mon Jul 25 18:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:26.565208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbb4de-da73-4602-9bf1-fe996524bc9a None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:26.645382 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:26.664546 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbb4de-da73-4602-9bf1-fe996524bc9a None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:26.697965 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30899f-a917-4f02-b0f4-9a4b34cfae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:26.698636 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30899f-a917-4f02-b0f4-9a4b34cfae13 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:26.698926 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30899f-a917-4f02-b0f4-9a4b34cfae13 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:26.699236 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30899f-a917-4f02-b0f4-9a4b34cfae13 None admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:26.699984 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30899f-a917-4f02-b0f4-9a4b34cfae13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:26.700296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30899f-a917-4f02-b0f4-9a4b34cfae13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:26.701710 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30899f-a917-4f02-b0f4-9a4b34cfae13 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:26.709785 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 450/898] 10.222.0.98 () {56 vars in 1099 bytes} [Mon Jul 25 18:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:26.715609 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21b683-3a9f-4b57-a6f4-8e302fcc2d3b None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:26.814251 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21b683-3a9f-4b57-a6f4-8e302fcc2d3b None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:26.847170 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a973-6fd6-4f66-b5f4-0111f6998283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:26.847949 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a973-6fd6-4f66-b5f4-0111f6998283 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:26.848238 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a973-6fd6-4f66-b5f4-0111f6998283 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:26.849021 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a973-6fd6-4f66-b5f4-0111f6998283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:26.859302 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a973-6fd6-4f66-b5f4-0111f6998283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:26.860760 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a973-6fd6-4f66-b5f4-0111f6998283 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-8986a973-6fd6-4f66-b5f4-0111f6998283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:26.877843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:26.879181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:26.880330 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:26.880330 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:26.880330 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:26.880330 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:26.880330 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 449/899] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:26.885097 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30899f-a917-4f02-b0f4-9a4b34cfae13 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:26.983899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30899f-a917-4f02-b0f4-9a4b34cfae13 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:27.024183 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc3c3e-5b87-4c3e-b0df-6d1a98a2ec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:27.025353 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc3c3e-5b87-4c3e-b0df-6d1a98a2ec85 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:27.025869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc3c3e-5b87-4c3e-b0df-6d1a98a2ec85 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:27.026379 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc3c3e-5b87-4c3e-b0df-6d1a98a2ec85 None admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:27.027830 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc3c3e-5b87-4c3e-b0df-6d1a98a2ec85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:27.028410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc3c3e-5b87-4c3e-b0df-6d1a98a2ec85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:27.030647 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc3c3e-5b87-4c3e-b0df-6d1a98a2ec85 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:27.045133 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 451/900] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:27.050823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a973-6fd6-4f66-b5f4-0111f6998283 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:27.079527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:27.154430 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a973-6fd6-4f66-b5f4-0111f6998283 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:27.188369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfe5a2-71cc-4e38-8ef7-64d1089ab96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:27.189181 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfe5a2-71cc-4e38-8ef7-64d1089ab96d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:27.189467 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfe5a2-71cc-4e38-8ef7-64d1089ab96d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:27.189743 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfe5a2-71cc-4e38-8ef7-64d1089ab96d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:27.199911 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfe5a2-71cc-4e38-8ef7-64d1089ab96d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:27.201417 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfe5a2-71cc-4e38-8ef7-64d1089ab96d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-cedfe5a2-71cc-4e38-8ef7-64d1089ab96d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 18:59:27.222255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:27.223326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:27.224267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:27.224267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:27.224267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 18:59:27.224267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 18:59:27.224267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 18:59:27.224267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 18:59:27.224267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 18:59:27.224267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 18:59:27.224267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 18:59:27.224267 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:27.227466 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 450/901] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:27.240738 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc3c3e-5b87-4c3e-b0df-6d1a98a2ec85 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:27.244707 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:27.376775 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc3c3e-5b87-4c3e-b0df-6d1a98a2ec85 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:27.424085 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8deac-3dd3-44a8-88e4-5d6f2c0d2fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:27.424761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8deac-3dd3-44a8-88e4-5d6f2c0d2fc2 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:27.425050 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8deac-3dd3-44a8-88e4-5d6f2c0d2fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:27.425330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8deac-3dd3-44a8-88e4-5d6f2c0d2fc2 None admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:27.426170 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8deac-3dd3-44a8-88e4-5d6f2c0d2fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:27.427207 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8deac-3dd3-44a8-88e4-5d6f2c0d2fc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:27.428732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8deac-3dd3-44a8-88e4-5d6f2c0d2fc2 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:27.446865 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 452/902] 10.222.0.98 () {56 vars in 1143 bytes} [Mon Jul 25 18:59:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 18:59:27.453017 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfe5a2-71cc-4e38-8ef7-64d1089ab96d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:27.541729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:27.557062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfe5a2-71cc-4e38-8ef7-64d1089ab96d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:27.590408 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e5c3-1edf-4e2e-ba49-25b78e5c684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:27.591054 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e5c3-1edf-4e2e-ba49-25b78e5c684d None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:27.591378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e5c3-1edf-4e2e-ba49-25b78e5c684d None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:27.591656 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e5c3-1edf-4e2e-ba49-25b78e5c684d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:27.657484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46e5c3-1edf-4e2e-ba49-25b78e5c684d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:27.658856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46e5c3-1edf-4e2e-ba49-25b78e5c684d None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:27.740212 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:27.755731 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 451/903] 10.222.0.98 () {58 vars in 1282 bytes} [Mon Jul 25 18:59:27 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 18:59:27.761512 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8deac-3dd3-44a8-88e4-5d6f2c0d2fc2 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:27.821825 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:27.860330 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8deac-3dd3-44a8-88e4-5d6f2c0d2fc2 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:27.893577 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defaf14-d805-4d1a-8de8-42e6b3023750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:27.894359 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defaf14-d805-4d1a-8de8-42e6b3023750 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:27.894649 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defaf14-d805-4d1a-8de8-42e6b3023750 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:27.894925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defaf14-d805-4d1a-8de8-42e6b3023750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:27.905243 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defaf14-d805-4d1a-8de8-42e6b3023750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:27.906695 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defaf14-d805-4d1a-8de8-42e6b3023750 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-9defaf14-d805-4d1a-8de8-42e6b3023750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 18:59:27.924436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:27.925477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:27.926703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 18:59:27.926703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 18:59:27.926703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 18:59:27.926703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:27.926703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 453/904] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 18:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:27.931800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e5c3-1edf-4e2e-ba49-25b78e5c684d None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:28.028232 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e5c3-1edf-4e2e-ba49-25b78e5c684d None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:28.061979 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ac349-9e2f-4e27-a719-05a3e2f4daf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:28.062630 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ac349-9e2f-4e27-a719-05a3e2f4daf9 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:28.062912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ac349-9e2f-4e27-a719-05a3e2f4daf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:28.063215 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ac349-9e2f-4e27-a719-05a3e2f4daf9 None admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:28.063932 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ac349-9e2f-4e27-a719-05a3e2f4daf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:28.064240 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ac349-9e2f-4e27-a719-05a3e2f4daf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:28.065590 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ac349-9e2f-4e27-a719-05a3e2f4daf9 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:28.077110 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 452/905] 10.222.0.98 () {56 vars in 1109 bytes} [Mon Jul 25 18:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:28.082994 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defaf14-d805-4d1a-8de8-42e6b3023750 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:28.180403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defaf14-d805-4d1a-8de8-42e6b3023750 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:28.194080 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:28.213626 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2522f24-fc75-46c9-a0e0-b470bbc9684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:28.214410 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2522f24-fc75-46c9-a0e0-b470bbc9684d None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:28.214693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2522f24-fc75-46c9-a0e0-b470bbc9684d None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:28.214967 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2522f24-fc75-46c9-a0e0-b470bbc9684d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:28.221372 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2522f24-fc75-46c9-a0e0-b470bbc9684d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:28.222804 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2522f24-fc75-46c9-a0e0-b470bbc9684d None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application [None req-b2522f24-fc75-46c9-a0e0-b470bbc9684d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 18:59:28.236642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:28.237683 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:28.238665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 18:59:28.238665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 18:59:28.238665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 18:59:28.238665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 18:59:28.238665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 18:59:28.238665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 18:59:28.238665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 18:59:28.238665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: ERROR keystone.server.flask.application Jul 25 18:59:28.238665 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 454/906] 10.222.0.98 () {56 vars in 1111 bytes} [Mon Jul 25 18:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:28.244479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ac349-9e2f-4e27-a719-05a3e2f4daf9 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:28.290747 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:28.345223 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ac349-9e2f-4e27-a719-05a3e2f4daf9 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:28.378142 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3244c11-c1ea-49fe-80aa-28d0948ab4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:28.379053 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3244c11-c1ea-49fe-80aa-28d0948ab4f1 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:28.379366 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3244c11-c1ea-49fe-80aa-28d0948ab4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:28.380168 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3244c11-c1ea-49fe-80aa-28d0948ab4f1 None admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:28.380943 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3244c11-c1ea-49fe-80aa-28d0948ab4f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:28.381255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3244c11-c1ea-49fe-80aa-28d0948ab4f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:28.382674 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3244c11-c1ea-49fe-80aa-28d0948ab4f1 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:28.394254 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 453/907] 10.222.0.98 () {56 vars in 1148 bytes} [Mon Jul 25 18:59:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:28.401131 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2522f24-fc75-46c9-a0e0-b470bbc9684d None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:28.526897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2522f24-fc75-46c9-a0e0-b470bbc9684d None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:28.566100 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d75e37-cd97-430a-9b94-28f056c6d792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:28.566828 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d75e37-cd97-430a-9b94-28f056c6d792 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:28.567833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d75e37-cd97-430a-9b94-28f056c6d792 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:28.568124 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d75e37-cd97-430a-9b94-28f056c6d792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:28.568965 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d75e37-cd97-430a-9b94-28f056c6d792 None admin] RBAC: Adding query filter params (role.id=472a286d91bd484a83e2de07fc231c06, scope.project.id=55faf272643648349c655751011854b8, user.id=679756d5f79e451bba682356d961883f) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:28.569280 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d75e37-cd97-430a-9b94-28f056c6d792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:28.570728 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d75e37-cd97-430a-9b94-28f056c6d792 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:28.578260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 455/908] 10.222.0.98 () {56 vars in 1374 bytes} [Mon Jul 25 18:59:28 2022] GET /identity/v3/role_assignments?user.id=679756d5f79e451bba682356d961883f&scope.project.id=55faf272643648349c655751011854b8&role.id=472a286d91bd484a83e2de07fc231c06 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:30.900868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1c2ea-2bda-4d8a-bb9d-359747b8d040 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:30.901454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1c2ea-2bda-4d8a-bb9d-359747b8d040 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:30.901454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1c2ea-2bda-4d8a-bb9d-359747b8d040 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:30.902788 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 454/909] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:59:30.913186 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79350-f09c-4168-98e4-34072e3af49c None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:30.913618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79350-f09c-4168-98e4-34072e3af49c None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:30.913770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79350-f09c-4168-98e4-34072e3af49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:30.932864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-1db79350-f09c-4168-98e4-34072e3af49c None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:59:30.934057 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-1db79350-f09c-4168-98e4-34072e3af49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:59:30.966805 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:31.020929 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 456/910] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:59:30 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:59:31.050705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1c2ea-2bda-4d8a-bb9d-359747b8d040 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:31.176080 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1c2ea-2bda-4d8a-bb9d-359747b8d040 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:31.184988 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:31.223062 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91d4ec-e641-42f6-8766-43fd60610b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:31.224963 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91d4ec-e641-42f6-8766-43fd60610b36 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:31.225249 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91d4ec-e641-42f6-8766-43fd60610b36 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:31.225526 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91d4ec-e641-42f6-8766-43fd60610b36 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:31.226174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91d4ec-e641-42f6-8766-43fd60610b36 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:31.227573 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91d4ec-e641-42f6-8766-43fd60610b36 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-ca91d4ec-e641-42f6-8766-43fd60610b36 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:31.242089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:31.243368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:31.244482 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 455/911] 10.222.0.98 () {56 vars in 1117 bytes} [Mon Jul 25 18:59:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:31.249974 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79350-f09c-4168-98e4-34072e3af49c None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:31.380558 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79350-f09c-4168-98e4-34072e3af49c None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:31.420253 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66f5e1-bc91-476b-9a08-ae752519bfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:31.421016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f5e1-bc91-476b-9a08-ae752519bfd5 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:31.421300 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f5e1-bc91-476b-9a08-ae752519bfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:31.421574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f5e1-bc91-476b-9a08-ae752519bfd5 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:31.422277 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66f5e1-bc91-476b-9a08-ae752519bfd5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:31.422585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66f5e1-bc91-476b-9a08-ae752519bfd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:31.424116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66f5e1-bc91-476b-9a08-ae752519bfd5 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:31.430492 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 457/912] 10.222.0.98 () {56 vars in 1116 bytes} [Mon Jul 25 18:59:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:31.437608 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91d4ec-e641-42f6-8766-43fd60610b36 None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:31.543477 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91d4ec-e641-42f6-8766-43fd60610b36 None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:31.577843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40748c86-a9c1-4a65-8ef8-63c6e0f859d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:31.578503 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40748c86-a9c1-4a65-8ef8-63c6e0f859d6 None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:31.578786 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40748c86-a9c1-4a65-8ef8-63c6e0f859d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:31.579058 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40748c86-a9c1-4a65-8ef8-63c6e0f859d6 None admin] PATH_INFO: `/v3/services` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:31.579782 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40748c86-a9c1-4a65-8ef8-63c6e0f859d6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:31.580086 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40748c86-a9c1-4a65-8ef8-63c6e0f859d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:31.581441 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40748c86-a9c1-4a65-8ef8-63c6e0f859d6 None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:31.586824 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 456/913] 10.222.0.98 () {56 vars in 1116 bytes} [Mon Jul 25 18:59:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:33.879913 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3795d-cce6-4c1b-b337-830424dc7aa7 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:33.880468 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3795d-cce6-4c1b-b337-830424dc7aa7 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:33.880566 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3795d-cce6-4c1b-b337-830424dc7aa7 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:33.881882 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 458/914] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:59:33.886937 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78a6d-2a11-469b-9b4a-4aaa02edb505 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:33.887389 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78a6d-2a11-469b-9b4a-4aaa02edb505 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:33.887531 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78a6d-2a11-469b-9b4a-4aaa02edb505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:33.906253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-69c78a6d-2a11-469b-9b4a-4aaa02edb505 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:59:33.907505 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-69c78a6d-2a11-469b-9b4a-4aaa02edb505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:59:33.934430 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:33.974634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 457/915] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:59:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:59:33.997708 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3795d-cce6-4c1b-b337-830424dc7aa7 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:34.029054 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:34.101582 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3795d-cce6-4c1b-b337-830424dc7aa7 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:34.134663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95127441-d63c-4b2f-8e49-d05941dedbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:34.135337 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95127441-d63c-4b2f-8e49-d05941dedbe0 None admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:34.135620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95127441-d63c-4b2f-8e49-d05941dedbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:34.135895 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95127441-d63c-4b2f-8e49-d05941dedbe0 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:34.136607 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95127441-d63c-4b2f-8e49-d05941dedbe0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:34.137970 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95127441-d63c-4b2f-8e49-d05941dedbe0 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:34.153149 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 459/916] 10.222.0.98 () {60 vars in 1141 bytes} [Mon Jul 25 18:59:33 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 18:59:36.407738 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dadb2-4d15-469c-959e-d3024d4efc55 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:36.408260 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dadb2-4d15-469c-959e-d3024d4efc55 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:36.408348 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dadb2-4d15-469c-959e-d3024d4efc55 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:36.409643 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 458/917] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:59:36.415654 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385ecc9-0ac7-4f57-a4ba-241fa392079f None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:36.416072 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385ecc9-0ac7-4f57-a4ba-241fa392079f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:36.416223 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385ecc9-0ac7-4f57-a4ba-241fa392079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:36.434902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-3385ecc9-0ac7-4f57-a4ba-241fa392079f None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:59:36.436152 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-3385ecc9-0ac7-4f57-a4ba-241fa392079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:59:36.505678 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 460/918] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:59:36 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:59:36.529632 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dadb2-4d15-469c-959e-d3024d4efc55 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:36.637047 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dadb2-4d15-469c-959e-d3024d4efc55 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:36.671187 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77671c71-344d-4ac7-8d5a-d54d2e684a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:36.671908 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77671c71-344d-4ac7-8d5a-d54d2e684a9a None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:36.672194 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77671c71-344d-4ac7-8d5a-d54d2e684a9a None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:36.672465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77671c71-344d-4ac7-8d5a-d54d2e684a9a None admin] PATH_INFO: `/v3/services/placement` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:36.673102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77671c71-344d-4ac7-8d5a-d54d2e684a9a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:36.674478 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77671c71-344d-4ac7-8d5a-d54d2e684a9a None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-77671c71-344d-4ac7-8d5a-d54d2e684a9a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:36.687323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:36.688391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:36.689282 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 459/919] 10.222.0.98 () {56 vars in 1117 bytes} [Mon Jul 25 18:59:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:36.694651 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385ecc9-0ac7-4f57-a4ba-241fa392079f None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:36.712542 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:36.794822 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385ecc9-0ac7-4f57-a4ba-241fa392079f None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:36.828162 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e3577-19be-4a11-b7b9-23d4c2189d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:36.828819 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e3577-19be-4a11-b7b9-23d4c2189d72 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:36.829106 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e3577-19be-4a11-b7b9-23d4c2189d72 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:36.829382 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e3577-19be-4a11-b7b9-23d4c2189d72 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:36.830081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e3577-19be-4a11-b7b9-23d4c2189d72 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:36.830386 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e3577-19be-4a11-b7b9-23d4c2189d72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:36.831797 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e3577-19be-4a11-b7b9-23d4c2189d72 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:36.837398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 461/920] 10.222.0.98 () {56 vars in 1116 bytes} [Mon Jul 25 18:59:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:36.843437 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77671c71-344d-4ac7-8d5a-d54d2e684a9a None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:36.871650 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:36.941174 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77671c71-344d-4ac7-8d5a-d54d2e684a9a None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:36.974405 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0462d-a7b9-4d6e-961b-93dd8bd1d92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:36.975047 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0462d-a7b9-4d6e-961b-93dd8bd1d92c None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:36.975361 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0462d-a7b9-4d6e-961b-93dd8bd1d92c None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:36.975829 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0462d-a7b9-4d6e-961b-93dd8bd1d92c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:36.976628 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0462d-a7b9-4d6e-961b-93dd8bd1d92c None admin] RBAC: Adding query filter params (interface=public, service_id=27cb3552ad924fb1b18f9d9de58092b2, region_id=RegionOne) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:36.976944 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0462d-a7b9-4d6e-961b-93dd8bd1d92c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:36.978307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0462d-a7b9-4d6e-961b-93dd8bd1d92c None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:36.983417 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 460/921] 10.222.0.98 () {56 vars in 1251 bytes} [Mon Jul 25 18:59:36 2022] GET /identity/v3/endpoints?service_id=27cb3552ad924fb1b18f9d9de58092b2&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:36.989170 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e3577-19be-4a11-b7b9-23d4c2189d72 None admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:37.068667 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:37.087374 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e3577-19be-4a11-b7b9-23d4c2189d72 None admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:37.120462 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62160c2-3e64-4a6b-a7b6-e49fd262b8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:37.121113 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62160c2-3e64-4a6b-a7b6-e49fd262b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:37.121400 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62160c2-3e64-4a6b-a7b6-e49fd262b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:37.121675 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62160c2-3e64-4a6b-a7b6-e49fd262b8c9 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:37.122517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62160c2-3e64-4a6b-a7b6-e49fd262b8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:37.123797 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62160c2-3e64-4a6b-a7b6-e49fd262b8c9 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:37.130927 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 462/922] 10.222.0.98 () {56 vars in 1087 bytes} [Mon Jul 25 18:59:36 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 18:59:39.336437 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206e80-595c-4eeb-bc41-16a382a0a030 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:39.337033 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206e80-595c-4eeb-bc41-16a382a0a030 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:39.337033 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206e80-595c-4eeb-bc41-16a382a0a030 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:39.338398 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 461/923] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 18:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 18:59:39.343590 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bebca9-fd4e-41a5-a218-ccaec71381ed None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:39.343991 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bebca9-fd4e-41a5-a218-ccaec71381ed None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:39.344148 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bebca9-fd4e-41a5-a218-ccaec71381ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:39.362562 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-32bebca9-fd4e-41a5-a218-ccaec71381ed None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 18:59:39.364294 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-32bebca9-fd4e-41a5-a218-ccaec71381ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 18:59:39.428966 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 463/924] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 18:59:39 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 18:59:39.452676 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b206e80-595c-4eeb-bc41-16a382a0a030 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:39.543027 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:39.552419 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b206e80-595c-4eeb-bc41-16a382a0a030 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:39.585253 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6bad-c4d5-4d7a-bb0f-5bf55a58c7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:39.586046 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6bad-c4d5-4d7a-bb0f-5bf55a58c7ec None admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:39.586333 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6bad-c4d5-4d7a-bb0f-5bf55a58c7ec None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:39.586659 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6bad-c4d5-4d7a-bb0f-5bf55a58c7ec None admin] PATH_INFO: `/v3/services/placement` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:39.587290 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed6bad-c4d5-4d7a-bb0f-5bf55a58c7ec None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:39.588653 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed6bad-c4d5-4d7a-bb0f-5bf55a58c7ec None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application [None req-c9ed6bad-c4d5-4d7a-bb0f-5bf55a58c7ec None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 18:59:39.600426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 18:59:39.601582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application with Lock( Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self._enter() Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application return self.creator() Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application created_value = creator( Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: ERROR keystone.server.flask.application Jul 25 18:59:39.602635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 462/925] 10.222.0.98 () {56 vars in 1117 bytes} [Mon Jul 25 18:59:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 18:59:39.609799 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bebca9-fd4e-41a5-a218-ccaec71381ed None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:39.684263 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:39.708282 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bebca9-fd4e-41a5-a218-ccaec71381ed None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:39.740630 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630fe74-de41-4bf4-ac9d-9fef9a4a64d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:39.741284 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fe74-de41-4bf4-ac9d-9fef9a4a64d7 None admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:39.741568 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fe74-de41-4bf4-ac9d-9fef9a4a64d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:39.741844 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fe74-de41-4bf4-ac9d-9fef9a4a64d7 None admin] PATH_INFO: `/v3/services` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:39.742541 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630fe74-de41-4bf4-ac9d-9fef9a4a64d7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 18:59:39.742850 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630fe74-de41-4bf4-ac9d-9fef9a4a64d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:39.744252 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630fe74-de41-4bf4-ac9d-9fef9a4a64d7 None admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:39.749183 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 464/926] 10.222.0.98 () {56 vars in 1116 bytes} [Mon Jul 25 18:59:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 18:59:39.755997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6bad-c4d5-4d7a-bb0f-5bf55a58c7ec None admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 18:59:39.860908 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6bad-c4d5-4d7a-bb0f-5bf55a58c7ec None admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 18:59:39.894277 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fda818-75c1-430d-9178-41dbd23f2ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 18:59:39.895193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fda818-75c1-430d-9178-41dbd23f2ddd None admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 18:59:39.895478 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fda818-75c1-430d-9178-41dbd23f2ddd None admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 18:59:39.895750 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fda818-75c1-430d-9178-41dbd23f2ddd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 18:59:39.896487 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fda818-75c1-430d-9178-41dbd23f2ddd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 18:59:39.897834 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fda818-75c1-430d-9178-41dbd23f2ddd None admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 18:59:39.917387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 463/927] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 18:59:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 18:59:49.746364 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=30 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:59:49.913029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:00:38.610996 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea781af-5d77-443c-8127-5cbb64f2bcbd None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:38.612076 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea781af-5d77-443c-8127-5cbb64f2bcbd None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:38.614345 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea781af-5d77-443c-8127-5cbb64f2bcbd None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:38.618965 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 465/928] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:00:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:00:38.621975 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37271a-231b-43b1-a5f1-e179d7dabf9e None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:38.622509 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37271a-231b-43b1-a5f1-e179d7dabf9e None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:38.622509 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37271a-231b-43b1-a5f1-e179d7dabf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:38.660445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-4e37271a-231b-43b1-a5f1-e179d7dabf9e None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:00:38.662136 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-4e37271a-231b-43b1-a5f1-e179d7dabf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:00:38.755168 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 464/929] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:00:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:00:38.806556 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb144c-c287-47ac-98c6-dbfd5dc82985 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:38.806842 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb144c-c287-47ac-98c6-dbfd5dc82985 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:38.807117 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb144c-c287-47ac-98c6-dbfd5dc82985 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:38.808632 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 466/930] 10.222.0.98 () {54 vars in 965 bytes} [Mon Jul 25 19:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:00:38.814862 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3ff6-bdb6-459a-a1ca-4a65adf8e5be None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:38.815683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3ff6-bdb6-459a-a1ca-4a65adf8e5be None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:38.816465 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3ff6-bdb6-459a-a1ca-4a65adf8e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:38.900485 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-bbad3ff6-bdb6-459a-a1ca-4a65adf8e5be None None] MFA Rules not processed for user `b04784c6c0684d8082b954cd4caf32bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:00:38.902633 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-bbad3ff6-bdb6-459a-a1ca-4a65adf8e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:00:38.999038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 465/931] 10.222.0.98 () {58 vars in 1062 bytes} [Mon Jul 25 19:00:38 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:00:39.010959 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb144c-c287-47ac-98c6-dbfd5dc82985 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:00:39.032785 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb144c-c287-47ac-98c6-dbfd5dc82985 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:00:39.039585 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9771981-b5ba-4852-91c4-0b3915735751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:00:39.040913 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771981-b5ba-4852-91c4-0b3915735751 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:39.041470 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771981-b5ba-4852-91c4-0b3915735751 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:39.042144 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771981-b5ba-4852-91c4-0b3915735751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:39.059366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9771981-b5ba-4852-91c4-0b3915735751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:00:39.062118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9771981-b5ba-4852-91c4-0b3915735751 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:00:39.080977 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 467/932] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:00:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:00:41.640252 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd91d27-bfae-45ac-9937-51bedd183107 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:41.640777 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd91d27-bfae-45ac-9937-51bedd183107 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:41.640865 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd91d27-bfae-45ac-9937-51bedd183107 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:41.642375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 466/933] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:00:41.647573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be27d-045c-4256-88d5-076c7f881b3d None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:41.647972 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be27d-045c-4256-88d5-076c7f881b3d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:41.648143 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be27d-045c-4256-88d5-076c7f881b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:41.668662 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-aa8be27d-045c-4256-88d5-076c7f881b3d None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:00:41.670111 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-aa8be27d-045c-4256-88d5-076c7f881b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:00:41.683332 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 468/934] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:00:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:00:41.718377 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd91d27-bfae-45ac-9937-51bedd183107 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:00:41.729443 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd91d27-bfae-45ac-9937-51bedd183107 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:00:41.732951 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e0d1d-f77b-4449-a293-087739a4eeb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:00:41.733586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e0d1d-f77b-4449-a293-087739a4eeb7 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:41.733869 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e0d1d-f77b-4449-a293-087739a4eeb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:41.734144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e0d1d-f77b-4449-a293-087739a4eeb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:41.744634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e0d1d-f77b-4449-a293-087739a4eeb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:00:41.746224 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e0d1d-f77b-4449-a293-087739a4eeb7 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:00:41.757634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 467/935] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:00:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:00:44.504648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c106f03-da5e-4ebd-8cf3-99cf386255a2 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:44.505211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c106f03-da5e-4ebd-8cf3-99cf386255a2 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:44.505211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c106f03-da5e-4ebd-8cf3-99cf386255a2 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:44.506553 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 469/936] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 19:00:44.511933 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d9b7-31f4-459d-a725-fa946d73114b None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:44.512408 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d9b7-31f4-459d-a725-fa946d73114b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:44.512503 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d9b7-31f4-459d-a725-fa946d73114b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:44.557861 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-6f82d9b7-31f4-459d-a725-fa946d73114b None None] MFA Rules not processed for user `a751b52fcf40400e8553295a7aac987f`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:00:44.559106 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-6f82d9b7-31f4-459d-a725-fa946d73114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:00:44.607374 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:00:44.640810 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 468/937] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:00:44 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:00:44.700854 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99b29b-2bee-4c2c-bf67-d23632426542 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:44.701153 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99b29b-2bee-4c2c-bf67-d23632426542 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:44.701437 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99b29b-2bee-4c2c-bf67-d23632426542 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:44.702796 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 470/938] 10.222.0.98 () {54 vars in 965 bytes} [Mon Jul 25 19:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:00:44.709108 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5801f1-e1e2-4bdf-8f5e-f134d9bb6265 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:44.709402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5801f1-e1e2-4bdf-8f5e-f134d9bb6265 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:44.709680 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5801f1-e1e2-4bdf-8f5e-f134d9bb6265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:44.730078 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-fa5801f1-e1e2-4bdf-8f5e-f134d9bb6265 None None] MFA Rules not processed for user `b04784c6c0684d8082b954cd4caf32bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:00:44.731297 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-fa5801f1-e1e2-4bdf-8f5e-f134d9bb6265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:00:44.738198 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 469/939] 10.222.0.98 () {58 vars in 1062 bytes} [Mon Jul 25 19:00:44 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:00:44.746980 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99b29b-2bee-4c2c-bf67-d23632426542 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:00:44.759769 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99b29b-2bee-4c2c-bf67-d23632426542 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:00:44.763537 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718d9f-d05c-494b-83f0-be3964728856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:00:44.764255 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718d9f-d05c-494b-83f0-be3964728856 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:44.764611 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718d9f-d05c-494b-83f0-be3964728856 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:44.764958 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718d9f-d05c-494b-83f0-be3964728856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:44.774623 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05718d9f-d05c-494b-83f0-be3964728856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:00:44.776198 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05718d9f-d05c-494b-83f0-be3964728856 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:00:44.786994 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 471/940] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:00:44 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:00:48.137534 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66712a5-15c3-43d3-9194-62ece54957ae None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:48.138119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66712a5-15c3-43d3-9194-62ece54957ae None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:48.138119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66712a5-15c3-43d3-9194-62ece54957ae None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:48.139602 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 470/941] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:00:48.145278 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623786-577c-4a83-a43e-f98dbc38846b None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:48.145750 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623786-577c-4a83-a43e-f98dbc38846b None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:48.145852 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623786-577c-4a83-a43e-f98dbc38846b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:48.166163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-ca623786-577c-4a83-a43e-f98dbc38846b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:00:48.167209 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-ca623786-577c-4a83-a43e-f98dbc38846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:00:48.240785 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 472/942] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:00:48 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:00:48.282586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66712a5-15c3-43d3-9194-62ece54957ae None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:00:48.295387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66712a5-15c3-43d3-9194-62ece54957ae None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:00:48.299667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723be63-bd3c-45aa-a8f3-a2953370b27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:00:48.300177 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723be63-bd3c-45aa-a8f3-a2953370b27b service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:48.300458 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723be63-bd3c-45aa-a8f3-a2953370b27b service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:48.300728 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723be63-bd3c-45aa-a8f3-a2953370b27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:48.309859 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723be63-bd3c-45aa-a8f3-a2953370b27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:00:48.311397 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723be63-bd3c-45aa-a8f3-a2953370b27b service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:00:48.321911 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 471/943] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:00:48 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:00:51.380858 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f0879-a21c-4ab1-a771-8c38cb0324ec None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:51.381389 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f0879-a21c-4ab1-a771-8c38cb0324ec None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:51.381503 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f0879-a21c-4ab1-a771-8c38cb0324ec None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:51.382777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 473/944] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:00:51.388324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202093a-97c3-414f-8b8b-40f0c36f0fc6 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:51.388748 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202093a-97c3-414f-8b8b-40f0c36f0fc6 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:51.388966 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202093a-97c3-414f-8b8b-40f0c36f0fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:51.408745 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-d202093a-97c3-414f-8b8b-40f0c36f0fc6 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:00:51.409957 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-d202093a-97c3-414f-8b8b-40f0c36f0fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:00:51.418132 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 472/945] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:00:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:00:51.456016 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f0879-a21c-4ab1-a771-8c38cb0324ec None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:00:51.466740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f0879-a21c-4ab1-a771-8c38cb0324ec None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:00:51.470171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38961405-d2d4-4a7c-8d26-254ccea32894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:00:51.470837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38961405-d2d4-4a7c-8d26-254ccea32894 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:51.471141 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38961405-d2d4-4a7c-8d26-254ccea32894 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:51.471435 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38961405-d2d4-4a7c-8d26-254ccea32894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:51.480662 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38961405-d2d4-4a7c-8d26-254ccea32894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:00:51.482108 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38961405-d2d4-4a7c-8d26-254ccea32894 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:00:51.491712 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 474/946] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:00:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:00:53.780496 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f3d2-883d-489f-ad93-604cf294331b None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:53.781012 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f3d2-883d-489f-ad93-604cf294331b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:53.781012 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f3d2-883d-489f-ad93-604cf294331b None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:53.782330 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 473/947] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:00:53.787941 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ad80-2368-4014-bb5a-5f0dce784451 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:53.788383 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ad80-2368-4014-bb5a-5f0dce784451 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:53.788510 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ad80-2368-4014-bb5a-5f0dce784451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:53.808004 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-6b55ad80-2368-4014-bb5a-5f0dce784451 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:00:53.809199 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-6b55ad80-2368-4014-bb5a-5f0dce784451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:00:53.817824 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 475/948] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:00:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:00:53.854393 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5f3d2-883d-489f-ad93-604cf294331b None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:00:53.865186 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5f3d2-883d-489f-ad93-604cf294331b None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:00:53.868561 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ac2a7-3a6c-4738-bce8-4368119ebe7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:00:53.869187 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac2a7-3a6c-4738-bce8-4368119ebe7a service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:53.869468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac2a7-3a6c-4738-bce8-4368119ebe7a service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:53.869745 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac2a7-3a6c-4738-bce8-4368119ebe7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:53.879392 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ac2a7-3a6c-4738-bce8-4368119ebe7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:00:53.880816 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ac2a7-3a6c-4738-bce8-4368119ebe7a service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:00:53.890218 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 474/949] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:00:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:00:56.198322 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba5d39-518e-4d4f-9a94-3623309b7eb1 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:56.198855 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba5d39-518e-4d4f-9a94-3623309b7eb1 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:56.198959 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba5d39-518e-4d4f-9a94-3623309b7eb1 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:56.200367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 476/950] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:00:56.205690 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759579e6-5b19-48ce-b028-369f44cc53ac None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:56.206093 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759579e6-5b19-48ce-b028-369f44cc53ac None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:56.206255 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759579e6-5b19-48ce-b028-369f44cc53ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:56.225782 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-759579e6-5b19-48ce-b028-369f44cc53ac None None] MFA Rules not processed for user `a751b52fcf40400e8553295a7aac987f`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:00:56.226980 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-759579e6-5b19-48ce-b028-369f44cc53ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:00:56.234971 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 475/951] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:00:56 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:00:56.276730 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba5d39-518e-4d4f-9a94-3623309b7eb1 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:00:56.290014 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba5d39-518e-4d4f-9a94-3623309b7eb1 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:00:56.293599 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fc601-ca5f-4929-af28-22e213f6dbe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:00:56.294263 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fc601-ca5f-4929-af28-22e213f6dbe8 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:56.294587 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fc601-ca5f-4929-af28-22e213f6dbe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:56.294861 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fc601-ca5f-4929-af28-22e213f6dbe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:56.305318 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fc601-ca5f-4929-af28-22e213f6dbe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:00:56.306684 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fc601-ca5f-4929-af28-22e213f6dbe8 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:00:56.317379 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 477/952] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:00:56 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:00:58.820753 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779803-5b7e-4c9b-a13a-f2dfdde1867c None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:58.821294 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779803-5b7e-4c9b-a13a-f2dfdde1867c None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:58.821294 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779803-5b7e-4c9b-a13a-f2dfdde1867c None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:58.822825 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 476/953] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:00:58.827828 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d1e-ab7a-4f53-8d49-156be10474a3 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:58.828232 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d1e-ab7a-4f53-8d49-156be10474a3 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:58.828510 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d1e-ab7a-4f53-8d49-156be10474a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:58.848883 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-6a6d5d1e-ab7a-4f53-8d49-156be10474a3 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:00:58.850127 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-6a6d5d1e-ab7a-4f53-8d49-156be10474a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:00:58.858028 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 478/954] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:00:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:00:58.897231 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6779803-5b7e-4c9b-a13a-f2dfdde1867c None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:00:58.909145 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6779803-5b7e-4c9b-a13a-f2dfdde1867c None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:00:58.913098 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6bd75-bd9b-4558-af02-fad24caa4cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:00:58.913862 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bd75-bd9b-4558-af02-fad24caa4cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:00:58.914155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bd75-bd9b-4558-af02-fad24caa4cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:00:58.914436 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bd75-bd9b-4558-af02-fad24caa4cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:00:58.925271 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6bd75-bd9b-4558-af02-fad24caa4cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:00:58.926738 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6bd75-bd9b-4558-af02-fad24caa4cc1 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:00:58.937493 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 477/955] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:00:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:01.240815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb36c8-3178-46b7-90ba-eb881470b4a9 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:01.241334 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb36c8-3178-46b7-90ba-eb881470b4a9 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:01.241456 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb36c8-3178-46b7-90ba-eb881470b4a9 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:01.242742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 479/956] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:01.248100 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb43f0-4141-4965-9320-aa3e1b70a4c9 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:01.248550 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb43f0-4141-4965-9320-aa3e1b70a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:01.248783 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb43f0-4141-4965-9320-aa3e1b70a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:01.269037 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-d5cb43f0-4141-4965-9320-aa3e1b70a4c9 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:01.270378 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-d5cb43f0-4141-4965-9320-aa3e1b70a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:01.278936 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 478/957] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:01.320651 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb36c8-3178-46b7-90ba-eb881470b4a9 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:01.326022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=65 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:01:01.332561 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb36c8-3178-46b7-90ba-eb881470b4a9 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:01.336103 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a410fa-cbc9-483e-b0d7-b027035de973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:01.336741 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a410fa-cbc9-483e-b0d7-b027035de973 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:01.337024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a410fa-cbc9-483e-b0d7-b027035de973 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:01.337297 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a410fa-cbc9-483e-b0d7-b027035de973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:01.346899 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a410fa-cbc9-483e-b0d7-b027035de973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:01.348376 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a410fa-cbc9-483e-b0d7-b027035de973 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:01.357753 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 480/958] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:03.930153 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7af9b-2136-46ea-a755-76f66a430503 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:03.930683 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7af9b-2136-46ea-a755-76f66a430503 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:03.930776 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7af9b-2136-46ea-a755-76f66a430503 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:03.932120 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 479/959] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:03.937300 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7862a-667d-4d3b-adef-8b59c0842ca9 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:03.937701 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7862a-667d-4d3b-adef-8b59c0842ca9 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:03.937858 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7862a-667d-4d3b-adef-8b59c0842ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:03.957399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-6eb7862a-667d-4d3b-adef-8b59c0842ca9 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:03.958534 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-6eb7862a-667d-4d3b-adef-8b59c0842ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:03.966298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 481/960] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:03 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:04.004514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7af9b-2136-46ea-a755-76f66a430503 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:04.014969 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7af9b-2136-46ea-a755-76f66a430503 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:04.018897 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d078ce-2c7a-48db-b5b1-127ee4693b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:04.019567 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d078ce-2c7a-48db-b5b1-127ee4693b03 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:04.019852 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d078ce-2c7a-48db-b5b1-127ee4693b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:04.020128 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d078ce-2c7a-48db-b5b1-127ee4693b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:04.029001 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d078ce-2c7a-48db-b5b1-127ee4693b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:04.030421 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d078ce-2c7a-48db-b5b1-127ee4693b03 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:04.040195 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 480/961] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:04 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:08.272817 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b762c-94fc-49c7-8ae5-ce9275dfc929 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:08.273336 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b762c-94fc-49c7-8ae5-ce9275dfc929 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:08.273336 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b762c-94fc-49c7-8ae5-ce9275dfc929 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:08.274647 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 482/962] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:08.279825 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3128a2a-a086-4f6f-829f-dcbde7a3dbb7 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:08.280206 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3128a2a-a086-4f6f-829f-dcbde7a3dbb7 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:08.280373 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3128a2a-a086-4f6f-829f-dcbde7a3dbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:08.300733 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-a3128a2a-a086-4f6f-829f-dcbde7a3dbb7 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:08.301912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-a3128a2a-a086-4f6f-829f-dcbde7a3dbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:08.309502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 481/963] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:08.350573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b762c-94fc-49c7-8ae5-ce9275dfc929 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:08.361576 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b762c-94fc-49c7-8ae5-ce9275dfc929 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:08.365166 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeffa3-f64d-463d-93fc-f0d761a32bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:08.365803 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeffa3-f64d-463d-93fc-f0d761a32bdd service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:08.366091 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeffa3-f64d-463d-93fc-f0d761a32bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:08.366370 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeffa3-f64d-463d-93fc-f0d761a32bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:08.375583 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeffa3-f64d-463d-93fc-f0d761a32bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:08.377080 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeffa3-f64d-463d-93fc-f0d761a32bdd service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:08.386507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 483/964] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:11.257927 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf8300-7cd2-4ec7-9e80-7e2812eadadd None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:11.258415 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf8300-7cd2-4ec7-9e80-7e2812eadadd None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:11.258507 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf8300-7cd2-4ec7-9e80-7e2812eadadd None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:11.260010 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 482/965] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:11.264964 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02a93d-7ec0-4abc-813b-a3ecc502d9c6 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:11.265381 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02a93d-7ec0-4abc-813b-a3ecc502d9c6 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:11.265522 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02a93d-7ec0-4abc-813b-a3ecc502d9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:11.284431 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-0b02a93d-7ec0-4abc-813b-a3ecc502d9c6 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:11.285615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-0b02a93d-7ec0-4abc-813b-a3ecc502d9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:11.293453 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 484/966] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:11 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:11.332037 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf8300-7cd2-4ec7-9e80-7e2812eadadd None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:11.342679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf8300-7cd2-4ec7-9e80-7e2812eadadd None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:11.346375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02652e-3596-4ab6-803c-289e88209f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:11.347015 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02652e-3596-4ab6-803c-289e88209f8a service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:11.347338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02652e-3596-4ab6-803c-289e88209f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:11.347615 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02652e-3596-4ab6-803c-289e88209f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:11.356476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02652e-3596-4ab6-803c-289e88209f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:11.357991 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02652e-3596-4ab6-803c-289e88209f8a service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:11.368227 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 483/967] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:11 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:15.669126 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b72b-4b73-4689-abe4-9ea3a771396d None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:15.669622 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b72b-4b73-4689-abe4-9ea3a771396d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:15.669622 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b72b-4b73-4689-abe4-9ea3a771396d None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:15.670931 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 485/968] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:15.677466 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541dde-f009-45e9-b949-4d36a53f2107 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:15.677886 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541dde-f009-45e9-b949-4d36a53f2107 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:15.678106 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541dde-f009-45e9-b949-4d36a53f2107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:15.685400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=57 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:01:15.698618 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-4d541dde-f009-45e9-b949-4d36a53f2107 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:15.699857 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-4d541dde-f009-45e9-b949-4d36a53f2107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:15.707902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 484/969] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:15.747703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b72b-4b73-4689-abe4-9ea3a771396d None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:15.758892 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b72b-4b73-4689-abe4-9ea3a771396d None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:15.762371 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d5dc7-8965-441d-a14a-b0dd5ad11840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:15.763008 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d5dc7-8965-441d-a14a-b0dd5ad11840 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:15.763332 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d5dc7-8965-441d-a14a-b0dd5ad11840 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:15.763615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d5dc7-8965-441d-a14a-b0dd5ad11840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:15.773366 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d5dc7-8965-441d-a14a-b0dd5ad11840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:15.774799 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d5dc7-8965-441d-a14a-b0dd5ad11840 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:15.785714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 486/970] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:21.235996 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681026c1-8a15-4ac1-a380-0ed83e7573da None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:21.236827 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681026c1-8a15-4ac1-a380-0ed83e7573da None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:21.237900 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681026c1-8a15-4ac1-a380-0ed83e7573da None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:21.239575 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 485/971] 10.222.0.98 () {54 vars in 921 bytes} [Mon Jul 25 19:01:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:21.245058 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d872-ff53-464f-96de-4a277c8f78e1 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:21.245516 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d872-ff53-464f-96de-4a277c8f78e1 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:21.245659 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d872-ff53-464f-96de-4a277c8f78e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:21.295923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-ca07d872-ff53-464f-96de-4a277c8f78e1 None None] MFA Rules not processed for user `679756d5f79e451bba682356d961883f`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:21.298216 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-ca07d872-ff53-464f-96de-4a277c8f78e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:21.398309 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 487/972] 10.222.0.98 () {58 vars in 1018 bytes} [Mon Jul 25 19:01:21 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:25.693955 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=2 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:01:25.929142 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b38e-1952-488b-b621-89136081213e None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:25.929420 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b38e-1952-488b-b621-89136081213e None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:25.929699 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b38e-1952-488b-b621-89136081213e None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:25.931247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 486/973] 10.222.0.98 () {54 vars in 921 bytes} [Mon Jul 25 19:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:25.936327 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ebf5-cd53-449d-b468-86ed0aac95bc None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:25.936798 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ebf5-cd53-449d-b468-86ed0aac95bc None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:25.936915 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ebf5-cd53-449d-b468-86ed0aac95bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:25.961399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-7578ebf5-cd53-449d-b468-86ed0aac95bc None None] MFA Rules not processed for user `679756d5f79e451bba682356d961883f`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:25.962838 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-7578ebf5-cd53-449d-b468-86ed0aac95bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:25.973017 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 488/974] 10.222.0.98 () {58 vars in 1018 bytes} [Mon Jul 25 19:01:25 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:27.710198 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a0b1-83cc-4b35-b396-e86ec6d3592b None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:27.710682 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a0b1-83cc-4b35-b396-e86ec6d3592b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:27.710891 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a0b1-83cc-4b35-b396-e86ec6d3592b None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:27.712352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 487/975] 10.222.0.98 () {54 vars in 921 bytes} [Mon Jul 25 19:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:27.717315 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4de4d4-1407-4756-a453-67e1e2ab885c None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:27.717755 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4de4d4-1407-4756-a453-67e1e2ab885c None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:27.717877 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4de4d4-1407-4756-a453-67e1e2ab885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:27.739100 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-6c4de4d4-1407-4756-a453-67e1e2ab885c None None] MFA Rules not processed for user `679756d5f79e451bba682356d961883f`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:27.740572 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-6c4de4d4-1407-4756-a453-67e1e2ab885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:27.749293 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 489/976] 10.222.0.98 () {58 vars in 1018 bytes} [Mon Jul 25 19:01:27 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:01:31.677534 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b34f-7f34-483c-9020-e0934a0a82e1 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:31.678038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b34f-7f34-483c-9020-e0934a0a82e1 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:31.678038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b34f-7f34-483c-9020-e0934a0a82e1 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:31.681488 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 488/977] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:31.684826 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee36a2-137c-4ba7-8471-a764a2ba1025 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:31.685289 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee36a2-137c-4ba7-8471-a764a2ba1025 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:31.685595 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee36a2-137c-4ba7-8471-a764a2ba1025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:31.697385 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=69 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:01:31.711325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-91ee36a2-137c-4ba7-8471-a764a2ba1025 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:31.712675 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-91ee36a2-137c-4ba7-8471-a764a2ba1025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:31.721548 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 490/978] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:01:31.777787 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dafc3-cd48-48cd-9e1c-2cd714c43f62 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:31.778105 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dafc3-cd48-48cd-9e1c-2cd714c43f62 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:31.778483 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dafc3-cd48-48cd-9e1c-2cd714c43f62 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:31.779872 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 489/979] 10.222.0.98 () {54 vars in 962 bytes} [Mon Jul 25 19:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:31.790829 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bae3-cd8f-46e0-a7c4-cfe1165ce49b None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:31.791439 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bae3-cd8f-46e0-a7c4-cfe1165ce49b None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:31.791839 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bae3-cd8f-46e0-a7c4-cfe1165ce49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:31.838736 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-19a6bae3-cd8f-46e0-a7c4-cfe1165ce49b None None] MFA Rules not processed for user `6aa237d6badd493a9f2a75bf4086fec3`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:31.840139 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-19a6bae3-cd8f-46e0-a7c4-cfe1165ce49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:31.915742 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 491/980] 10.222.0.98 () {58 vars in 1059 bytes} [Mon Jul 25 19:01:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:31.924324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dafc3-cd48-48cd-9e1c-2cd714c43f62 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:31.937935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dafc3-cd48-48cd-9e1c-2cd714c43f62 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:31.942773 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ec1ff-0b9f-49b5-8732-3e4908565ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:31.943456 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ec1ff-0b9f-49b5-8732-3e4908565ff7 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:31.943747 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ec1ff-0b9f-49b5-8732-3e4908565ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:31.944026 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ec1ff-0b9f-49b5-8732-3e4908565ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:31.952286 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ec1ff-0b9f-49b5-8732-3e4908565ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:31.954018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ec1ff-0b9f-49b5-8732-3e4908565ff7 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:31.963780 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 490/981] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:34.442005 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f69a1-5650-46d8-8935-ced7f2944185 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:34.442550 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f69a1-5650-46d8-8935-ced7f2944185 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:34.442550 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f69a1-5650-46d8-8935-ced7f2944185 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:34.444153 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 492/982] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:34.449195 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f00f0-f2ad-428a-8af6-fb2687cadf6b None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:34.449634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f00f0-f2ad-428a-8af6-fb2687cadf6b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:34.449763 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f00f0-f2ad-428a-8af6-fb2687cadf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:34.469764 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-be7f00f0-f2ad-428a-8af6-fb2687cadf6b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:34.470973 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-be7f00f0-f2ad-428a-8af6-fb2687cadf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:34.479101 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 491/983] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:34.525661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f69a1-5650-46d8-8935-ced7f2944185 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:34.543904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f69a1-5650-46d8-8935-ced7f2944185 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:34.549064 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4294d-d1ab-4d54-82e7-358bd27a6b9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:34.549713 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4294d-d1ab-4d54-82e7-358bd27a6b9d service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:34.550000 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4294d-d1ab-4d54-82e7-358bd27a6b9d service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:34.550277 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4294d-d1ab-4d54-82e7-358bd27a6b9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:34.559222 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4294d-d1ab-4d54-82e7-358bd27a6b9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:34.560819 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4294d-d1ab-4d54-82e7-358bd27a6b9d service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:34.570921 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 493/984] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:37.153743 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0df53-9342-4dc2-b57b-01f7111de2e8 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:37.154243 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0df53-9342-4dc2-b57b-01f7111de2e8 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:37.154338 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0df53-9342-4dc2-b57b-01f7111de2e8 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:37.155700 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 492/985] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:37.161394 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256a6a3-0762-4a99-9797-f0ff80a22b3f None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:37.161843 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256a6a3-0762-4a99-9797-f0ff80a22b3f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:37.161982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256a6a3-0762-4a99-9797-f0ff80a22b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:37.182535 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-e256a6a3-0762-4a99-9797-f0ff80a22b3f None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:37.183759 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-e256a6a3-0762-4a99-9797-f0ff80a22b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:37.191971 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 494/986] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:37.239302 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498d2d-1b55-471c-ba06-e178a71895a5 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:37.239604 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498d2d-1b55-471c-ba06-e178a71895a5 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:37.239897 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498d2d-1b55-471c-ba06-e178a71895a5 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:37.241269 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 493/987] 10.222.0.98 () {54 vars in 962 bytes} [Mon Jul 25 19:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:37.246832 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6d0d-c3ee-4275-a38e-98f69b113678 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:37.247145 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6d0d-c3ee-4275-a38e-98f69b113678 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:37.247560 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6d0d-c3ee-4275-a38e-98f69b113678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:37.267466 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-717e6d0d-c3ee-4275-a38e-98f69b113678 None None] MFA Rules not processed for user `6aa237d6badd493a9f2a75bf4086fec3`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:37.268844 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-717e6d0d-c3ee-4275-a38e-98f69b113678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:37.278322 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 495/988] 10.222.0.98 () {58 vars in 1059 bytes} [Mon Jul 25 19:01:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:37.286958 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498d2d-1b55-471c-ba06-e178a71895a5 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:37.301332 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498d2d-1b55-471c-ba06-e178a71895a5 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:37.306273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154242f-18c2-4509-a8e5-1dc8ed256104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:37.306912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154242f-18c2-4509-a8e5-1dc8ed256104 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:37.307235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154242f-18c2-4509-a8e5-1dc8ed256104 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:37.307516 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154242f-18c2-4509-a8e5-1dc8ed256104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:37.321124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154242f-18c2-4509-a8e5-1dc8ed256104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:37.321124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154242f-18c2-4509-a8e5-1dc8ed256104 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:37.336793 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 494/989] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:39.668690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952433-c10c-4488-9f22-526bcc0f3643 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:39.669554 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952433-c10c-4488-9f22-526bcc0f3643 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:39.669987 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952433-c10c-4488-9f22-526bcc0f3643 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:39.676766 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 496/990] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:39.678280 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19783e-595e-4d89-80a5-8c7133f53781 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:39.679094 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19783e-595e-4d89-80a5-8c7133f53781 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:39.680092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19783e-595e-4d89-80a5-8c7133f53781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:39.706033 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-aa19783e-595e-4d89-80a5-8c7133f53781 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:39.707718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-aa19783e-595e-4d89-80a5-8c7133f53781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:39.716818 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 495/991] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:39.766075 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8952433-c10c-4488-9f22-526bcc0f3643 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:39.780504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8952433-c10c-4488-9f22-526bcc0f3643 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:39.787097 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e20d36-47ac-4740-b948-19796469618a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:39.787985 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e20d36-47ac-4740-b948-19796469618a service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:39.788419 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e20d36-47ac-4740-b948-19796469618a service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:39.788837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e20d36-47ac-4740-b948-19796469618a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:39.798574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e20d36-47ac-4740-b948-19796469618a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:39.800433 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e20d36-47ac-4740-b948-19796469618a service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:39.811547 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 497/992] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:42.142627 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562061-8a42-444b-b235-860ec47e8e3a None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:42.143206 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562061-8a42-444b-b235-860ec47e8e3a None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:42.143206 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562061-8a42-444b-b235-860ec47e8e3a None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:42.147354 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 496/993] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:42.159761 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a083a5-d55e-4abc-bd34-1cbc2f32b8ff None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:42.160616 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a083a5-d55e-4abc-bd34-1cbc2f32b8ff None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:42.160900 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a083a5-d55e-4abc-bd34-1cbc2f32b8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:42.194542 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-86a083a5-d55e-4abc-bd34-1cbc2f32b8ff None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:42.196185 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-86a083a5-d55e-4abc-bd34-1cbc2f32b8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:42.207673 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 498/994] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:42.419360 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bcb87-e4de-489f-88e9-7e90ee2f212e None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:42.419568 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bcb87-e4de-489f-88e9-7e90ee2f212e None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:42.420036 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bcb87-e4de-489f-88e9-7e90ee2f212e None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:42.421686 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 497/995] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:42.427033 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d028a-ee43-41ed-92f9-df08c9d1a6d5 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:42.427385 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d028a-ee43-41ed-92f9-df08c9d1a6d5 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:42.427670 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d028a-ee43-41ed-92f9-df08c9d1a6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:42.447395 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-9d6d028a-ee43-41ed-92f9-df08c9d1a6d5 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:42.448609 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-9d6d028a-ee43-41ed-92f9-df08c9d1a6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:42.457495 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 499/996] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:42.503635 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bcb87-e4de-489f-88e9-7e90ee2f212e None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:42.519348 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bcb87-e4de-489f-88e9-7e90ee2f212e None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:42.532254 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdad2bc-5678-442c-abf1-1bdf7ec2c6e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:42.533265 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdad2bc-5678-442c-abf1-1bdf7ec2c6e7 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:42.533265 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdad2bc-5678-442c-abf1-1bdf7ec2c6e7 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:42.533265 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdad2bc-5678-442c-abf1-1bdf7ec2c6e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:42.540111 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88860f-4c8c-422c-9999-46a9f037533f None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:42.540111 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88860f-4c8c-422c-9999-46a9f037533f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:42.540111 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88860f-4c8c-422c-9999-46a9f037533f None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:42.541163 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 500/997] 10.222.0.98 () {54 vars in 964 bytes} [Mon Jul 25 19:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:42.547321 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6ad7-967c-4dfd-aaf2-a497eee351c1 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:42.547744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6ad7-967c-4dfd-aaf2-a497eee351c1 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:42.547915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdad2bc-5678-442c-abf1-1bdf7ec2c6e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:42.548173 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6ad7-967c-4dfd-aaf2-a497eee351c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:42.549574 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdad2bc-5678-442c-abf1-1bdf7ec2c6e7 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:42.560937 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 498/998] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:42.595196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-53fc6ad7-967c-4dfd-aaf2-a497eee351c1 None None] MFA Rules not processed for user `c000c774dc134acabf8abaa701de3be4`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:42.595196 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-53fc6ad7-967c-4dfd-aaf2-a497eee351c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:42.670862 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 501/999] 10.222.0.98 () {58 vars in 1061 bytes} [Mon Jul 25 19:01:42 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:01:42.680276 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdad2bc-5678-442c-abf1-1bdf7ec2c6e7 service nova] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:42.695089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdad2bc-5678-442c-abf1-1bdf7ec2c6e7 service nova] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:42.699071 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36972f5c-beb9-46f5-984c-b77341258dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c000c774dc134acabf8abaa701de3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:42.699856 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36972f5c-beb9-46f5-984c-b77341258dcd service cinder] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:42.700210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36972f5c-beb9-46f5-984c-b77341258dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:42.700555 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36972f5c-beb9-46f5-984c-b77341258dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:42.712510 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36972f5c-beb9-46f5-984c-b77341258dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:42.714190 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36972f5c-beb9-46f5-984c-b77341258dcd service cinder] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:42.726532 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 499/1000] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:45.173713 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433838e-2bed-43af-ac22-0b8b173b0ded None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:45.174311 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433838e-2bed-43af-ac22-0b8b173b0ded None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:45.174311 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433838e-2bed-43af-ac22-0b8b173b0ded None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:45.175927 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 502/1001] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 19:01:45.181876 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572b36-285b-44de-a590-e4ad810850ae None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:45.182339 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572b36-285b-44de-a590-e4ad810850ae None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:45.182580 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572b36-285b-44de-a590-e4ad810850ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:45.205919 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-3b572b36-285b-44de-a590-e4ad810850ae None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:45.207843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-3b572b36-285b-44de-a590-e4ad810850ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:45.216025 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 500/1002] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:45.267089 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433838e-2bed-43af-ac22-0b8b173b0ded None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:45.277702 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:01:45.284073 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433838e-2bed-43af-ac22-0b8b173b0ded None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:45.290960 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448d94f-78b2-4b7d-9ac1-fd8935637cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:45.291776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448d94f-78b2-4b7d-9ac1-fd8935637cd8 service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:45.291954 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448d94f-78b2-4b7d-9ac1-fd8935637cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:45.292204 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448d94f-78b2-4b7d-9ac1-fd8935637cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:45.301624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448d94f-78b2-4b7d-9ac1-fd8935637cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:45.303273 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448d94f-78b2-4b7d-9ac1-fd8935637cd8 service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:45.315202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 503/1003] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:47.702063 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb10d5-853b-432a-a1ef-56d1ac67188f None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:47.702830 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb10d5-853b-432a-a1ef-56d1ac67188f None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:47.702830 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb10d5-853b-432a-a1ef-56d1ac67188f None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:47.704461 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 501/1004] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:47.710398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cfbcd-ac31-4b80-b778-0166e928247b None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:47.710973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cfbcd-ac31-4b80-b778-0166e928247b None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:47.710973 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cfbcd-ac31-4b80-b778-0166e928247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:47.730496 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-3d0cfbcd-ac31-4b80-b778-0166e928247b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:47.731846 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-3d0cfbcd-ac31-4b80-b778-0166e928247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:47.740823 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 504/1005] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:47.783907 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb10d5-853b-432a-a1ef-56d1ac67188f None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:47.798015 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb10d5-853b-432a-a1ef-56d1ac67188f None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:47.802793 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed1122-a4ec-40f3-9f97-e8d24750c3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:47.803464 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed1122-a4ec-40f3-9f97-e8d24750c3ee service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:47.803755 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed1122-a4ec-40f3-9f97-e8d24750c3ee service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:47.804034 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed1122-a4ec-40f3-9f97-e8d24750c3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:47.813537 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed1122-a4ec-40f3-9f97-e8d24750c3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:47.815149 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed1122-a4ec-40f3-9f97-e8d24750c3ee service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:47.825314 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 502/1006] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:50.115947 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343c65-7589-480f-9d6b-4cf0be90956a None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:50.117266 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343c65-7589-480f-9d6b-4cf0be90956a None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:50.117992 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343c65-7589-480f-9d6b-4cf0be90956a None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:50.120780 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 505/1007] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:50.126673 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb4fe-b797-4b35-90ab-11bc703e19bb None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:50.127277 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb4fe-b797-4b35-90ab-11bc703e19bb None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:50.127277 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb4fe-b797-4b35-90ab-11bc703e19bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:50.146506 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-db7fb4fe-b797-4b35-90ab-11bc703e19bb None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:50.147742 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-db7fb4fe-b797-4b35-90ab-11bc703e19bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:50.162410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 503/1008] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:50.200716 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed343c65-7589-480f-9d6b-4cf0be90956a None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:50.216426 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed343c65-7589-480f-9d6b-4cf0be90956a None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:50.222170 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d651b-b2b0-42dc-a0a0-cad5ac9bec25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:50.222831 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d651b-b2b0-42dc-a0a0-cad5ac9bec25 service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:50.223121 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d651b-b2b0-42dc-a0a0-cad5ac9bec25 service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:50.223429 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d651b-b2b0-42dc-a0a0-cad5ac9bec25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:50.233365 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d651b-b2b0-42dc-a0a0-cad5ac9bec25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:50.235653 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d651b-b2b0-42dc-a0a0-cad5ac9bec25 service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:50.248168 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 506/1009] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:53.055386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85101d-4fca-4e90-a375-86863f4e68ca None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:53.056029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85101d-4fca-4e90-a375-86863f4e68ca None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:53.056029 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85101d-4fca-4e90-a375-86863f4e68ca None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:53.057210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 504/1010] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:53.064235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707270a-5f0a-49df-99c2-cc4be98cf407 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:53.064716 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707270a-5f0a-49df-99c2-cc4be98cf407 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:53.065039 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707270a-5f0a-49df-99c2-cc4be98cf407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:53.088008 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-b707270a-5f0a-49df-99c2-cc4be98cf407 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:53.089221 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-b707270a-5f0a-49df-99c2-cc4be98cf407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:53.097835 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 507/1011] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:53.146089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85101d-4fca-4e90-a375-86863f4e68ca None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:53.161027 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85101d-4fca-4e90-a375-86863f4e68ca None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:53.166711 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bca8e4-abca-438c-917d-6eddf3150900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:53.167393 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca8e4-abca-438c-917d-6eddf3150900 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:53.167677 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca8e4-abca-438c-917d-6eddf3150900 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:53.167949 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca8e4-abca-438c-917d-6eddf3150900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:53.177870 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bca8e4-abca-438c-917d-6eddf3150900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:53.179485 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bca8e4-abca-438c-917d-6eddf3150900 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:53.190626 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 505/1012] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:55.746938 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ace59c-91bc-4de4-bf75-4e571bb09797 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:55.747879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ace59c-91bc-4de4-bf75-4e571bb09797 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:55.747879 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ace59c-91bc-4de4-bf75-4e571bb09797 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:55.749756 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 508/1013] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:55.755152 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebab09a-9de7-4330-815a-f3ad3e534a81 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:55.755748 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebab09a-9de7-4330-815a-f3ad3e534a81 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:55.755748 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebab09a-9de7-4330-815a-f3ad3e534a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:55.763381 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=49 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:01:55.777424 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-cebab09a-9de7-4330-815a-f3ad3e534a81 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:55.778607 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-cebab09a-9de7-4330-815a-f3ad3e534a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:55.786714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 506/1014] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:55.834921 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ace59c-91bc-4de4-bf75-4e571bb09797 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:55.849025 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ace59c-91bc-4de4-bf75-4e571bb09797 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:55.854052 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0877872-dea7-4545-9490-5ce350fb8653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:55.854699 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0877872-dea7-4545-9490-5ce350fb8653 service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:55.854986 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0877872-dea7-4545-9490-5ce350fb8653 service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:55.855336 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0877872-dea7-4545-9490-5ce350fb8653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:55.865527 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0877872-dea7-4545-9490-5ce350fb8653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:55.867607 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0877872-dea7-4545-9490-5ce350fb8653 service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:55.880219 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 509/1015] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:59.015866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8704-10bd-425d-b595-460cec73af09 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:59.016460 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8704-10bd-425d-b595-460cec73af09 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:59.016460 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8704-10bd-425d-b595-460cec73af09 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:59.018095 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 507/1016] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:59.024021 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d469d4a-ba8e-4a0d-aacb-c52942dedd76 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:59.024640 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d469d4a-ba8e-4a0d-aacb-c52942dedd76 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:59.024640 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d469d4a-ba8e-4a0d-aacb-c52942dedd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:59.047734 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-2d469d4a-ba8e-4a0d-aacb-c52942dedd76 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:59.049015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-2d469d4a-ba8e-4a0d-aacb-c52942dedd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:59.057113 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 510/1017] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:59.103332 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b8704-10bd-425d-b595-460cec73af09 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:59.117618 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b8704-10bd-425d-b595-460cec73af09 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:59.122588 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a328688-bb06-4960-99c6-4598c6246d79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:59.123268 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328688-bb06-4960-99c6-4598c6246d79 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:59.123846 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328688-bb06-4960-99c6-4598c6246d79 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:59.124129 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328688-bb06-4960-99c6-4598c6246d79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:59.133134 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a328688-bb06-4960-99c6-4598c6246d79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:59.134725 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a328688-bb06-4960-99c6-4598c6246d79 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:59.145111 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 508/1018] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:01:59.192083 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b5b7e-6701-4e32-b059-f1b859b96459 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:59.192378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b5b7e-6701-4e32-b059-f1b859b96459 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:59.192661 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b5b7e-6701-4e32-b059-f1b859b96459 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:59.194035 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 511/1019] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:59.199690 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46779f-8068-4520-ae4a-def12298d8d7 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:59.200041 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46779f-8068-4520-ae4a-def12298d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:59.200329 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46779f-8068-4520-ae4a-def12298d8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:59.220844 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-4f46779f-8068-4520-ae4a-def12298d8d7 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:59.222096 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-4f46779f-8068-4520-ae4a-def12298d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:59.230368 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 509/1020] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:01:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:59.293618 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef631b6-ed37-4278-8f6a-3beaa47d6d02 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:59.293906 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef631b6-ed37-4278-8f6a-3beaa47d6d02 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:59.294180 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef631b6-ed37-4278-8f6a-3beaa47d6d02 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:59.295777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 512/1021] 10.222.0.98 () {54 vars in 966 bytes} [Mon Jul 25 19:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:01:59.302326 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87023e4-a366-4103-85bd-aed5475de905 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:59.302675 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87023e4-a366-4103-85bd-aed5475de905 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:59.302997 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87023e4-a366-4103-85bd-aed5475de905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:59.349102 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-c87023e4-a366-4103-85bd-aed5475de905 None None] MFA Rules not processed for user `1e21b5991e7345149a4d0e644a436099`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:01:59.350369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-c87023e4-a366-4103-85bd-aed5475de905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:01:59.417781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 510/1022] 10.222.0.98 () {58 vars in 1063 bytes} [Mon Jul 25 19:01:59 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:01:59.425431 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef631b6-ed37-4278-8f6a-3beaa47d6d02 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:01:59.436867 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef631b6-ed37-4278-8f6a-3beaa47d6d02 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:01:59.441164 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a3da0-71e6-4b2e-ab27-bc210fc4e82e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e21b5991e7345149a4d0e644a436099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:01:59.441827 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3da0-71e6-4b2e-ab27-bc210fc4e82e service glance] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:01:59.442110 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3da0-71e6-4b2e-ab27-bc210fc4e82e service glance] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:01:59.442387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3da0-71e6-4b2e-ab27-bc210fc4e82e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:01:59.453046 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a3da0-71e6-4b2e-ab27-bc210fc4e82e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:01:59.454507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a3da0-71e6-4b2e-ab27-bc210fc4e82e service glance] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:01:59.465011 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 513/1023] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:01:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:01.516596 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1096-f11b-46f3-9439-ec746cd0e513 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:01.517273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1096-f11b-46f3-9439-ec746cd0e513 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:01.517273 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1096-f11b-46f3-9439-ec746cd0e513 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:01.518666 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 511/1024] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:01.524130 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8698f57-e92e-4ffb-97ed-f35d89d63894 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:01.524676 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8698f57-e92e-4ffb-97ed-f35d89d63894 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:01.524676 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8698f57-e92e-4ffb-97ed-f35d89d63894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:01.550533 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-a8698f57-e92e-4ffb-97ed-f35d89d63894 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:01.552393 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-a8698f57-e92e-4ffb-97ed-f35d89d63894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:01.562421 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 514/1025] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:02:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:01.612112 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1096-f11b-46f3-9439-ec746cd0e513 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:01.636016 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1096-f11b-46f3-9439-ec746cd0e513 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:01.643157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f515f-205f-438e-9da4-7427b872ba16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:01.644977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f515f-205f-438e-9da4-7427b872ba16 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:01.644977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f515f-205f-438e-9da4-7427b872ba16 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:01.644977 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f515f-205f-438e-9da4-7427b872ba16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:01.653454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f515f-205f-438e-9da4-7427b872ba16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:01.656502 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f515f-205f-438e-9da4-7427b872ba16 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:01.666902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 512/1026] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:11.544007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=34 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:02:11.662391 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=50 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:02:15.155259 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49da725-72ff-4241-a056-be77fe9c498f None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:15.156118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49da725-72ff-4241-a056-be77fe9c498f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:15.156118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49da725-72ff-4241-a056-be77fe9c498f None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:15.157668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 515/1027] 10.222.0.98 () {54 vars in 918 bytes} [Mon Jul 25 19:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:15.165705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdb5b1-d473-422f-8939-b6390742dcf5 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:15.166418 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdb5b1-d473-422f-8939-b6390742dcf5 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:15.166418 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdb5b1-d473-422f-8939-b6390742dcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:15.188078 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-7ccdb5b1-d473-422f-8939-b6390742dcf5 None None] MFA Rules not processed for user `679756d5f79e451bba682356d961883f`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:15.189306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-7ccdb5b1-d473-422f-8939-b6390742dcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:15.198074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 513/1028] 10.222.0.98 () {58 vars in 1015 bytes} [Mon Jul 25 19:02:15 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:15.214806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8bbc1-a884-4fd0-ad5d-9515d7d50cd7 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:15.216321 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8bbc1-a884-4fd0-ad5d-9515d7d50cd7 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:15.216644 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8bbc1-a884-4fd0-ad5d-9515d7d50cd7 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:15.218338 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 516/1029] 10.222.0.98 () {54 vars in 918 bytes} [Mon Jul 25 19:02:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 19:02:15.223802 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51563c-d586-4676-8c32-bc1512d3dfb4 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:15.224094 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51563c-d586-4676-8c32-bc1512d3dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:15.224428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51563c-d586-4676-8c32-bc1512d3dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:15.244610 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-0b51563c-d586-4676-8c32-bc1512d3dfb4 None None] MFA Rules not processed for user `6aa237d6badd493a9f2a75bf4086fec3`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:15.245821 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-0b51563c-d586-4676-8c32-bc1512d3dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:15.255757 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 514/1030] 10.222.0.98 () {58 vars in 1015 bytes} [Mon Jul 25 19:02:15 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:18.080129 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d029752-5c1a-471a-a1e2-c348d4a12698 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:18.080981 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d029752-5c1a-471a-a1e2-c348d4a12698 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:18.080981 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d029752-5c1a-471a-a1e2-c348d4a12698 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:18.082691 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 517/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:18.088336 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d122970-a7be-44cf-877c-7abb6ce42eaa None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:18.088835 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d122970-a7be-44cf-877c-7abb6ce42eaa None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:18.088942 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d122970-a7be-44cf-877c-7abb6ce42eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:18.108813 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-5d122970-a7be-44cf-877c-7abb6ce42eaa None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:18.110026 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-5d122970-a7be-44cf-877c-7abb6ce42eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:18.119426 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 515/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:18.170817 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d029752-5c1a-471a-a1e2-c348d4a12698 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:18.187274 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d029752-5c1a-471a-a1e2-c348d4a12698 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:18.192277 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06849b1-1770-4b87-92ba-322b93e75afc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:18.192926 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06849b1-1770-4b87-92ba-322b93e75afc service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:18.193208 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06849b1-1770-4b87-92ba-322b93e75afc service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:18.193485 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06849b1-1770-4b87-92ba-322b93e75afc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:18.202780 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06849b1-1770-4b87-92ba-322b93e75afc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:18.204427 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06849b1-1770-4b87-92ba-322b93e75afc service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:18.214558 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 518/1033] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:19.191612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c34e-dfaa-41cd-a4f3-1340bd370041 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:19.192188 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c34e-dfaa-41cd-a4f3-1340bd370041 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:19.192188 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c34e-dfaa-41cd-a4f3-1340bd370041 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:19.193478 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 516/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:19.199006 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573509f-20c5-4ebb-b9fa-467e54ad512b None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:19.199557 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573509f-20c5-4ebb-b9fa-467e54ad512b None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:19.199663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573509f-20c5-4ebb-b9fa-467e54ad512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:19.222869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-b573509f-20c5-4ebb-b9fa-467e54ad512b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:19.224987 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-b573509f-20c5-4ebb-b9fa-467e54ad512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:19.236806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 519/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:02:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:19.470085 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c34e-dfaa-41cd-a4f3-1340bd370041 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:19.484762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c34e-dfaa-41cd-a4f3-1340bd370041 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:19.489650 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1373a-3d77-454d-810f-7fa233a32e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:19.490462 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1373a-3d77-454d-810f-7fa233a32e99 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:19.490754 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1373a-3d77-454d-810f-7fa233a32e99 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:19.491036 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1373a-3d77-454d-810f-7fa233a32e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:19.501679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1373a-3d77-454d-810f-7fa233a32e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:19.503385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1373a-3d77-454d-810f-7fa233a32e99 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:19.514580 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 517/1036] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:20.460065 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236418-01a7-4724-815d-44a408c4e6ad None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:20.460680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236418-01a7-4724-815d-44a408c4e6ad None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:20.460680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236418-01a7-4724-815d-44a408c4e6ad None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:20.462119 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 520/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:20.468260 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596cae8-ac82-4609-ab99-d910fa68c474 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:20.469055 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596cae8-ac82-4609-ab99-d910fa68c474 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:20.469244 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596cae8-ac82-4609-ab99-d910fa68c474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:20.489679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-9596cae8-ac82-4609-ab99-d910fa68c474 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:20.490910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-9596cae8-ac82-4609-ab99-d910fa68c474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:20.502009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 518/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:02:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:20.666490 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04236418-01a7-4724-815d-44a408c4e6ad None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:20.683867 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04236418-01a7-4724-815d-44a408c4e6ad None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:20.690633 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd485b-5bb8-4401-a0d2-a019b6afebf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:20.691449 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd485b-5bb8-4401-a0d2-a019b6afebf6 service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:20.691762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd485b-5bb8-4401-a0d2-a019b6afebf6 service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:20.692182 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd485b-5bb8-4401-a0d2-a019b6afebf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:20.704334 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd485b-5bb8-4401-a0d2-a019b6afebf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:20.705947 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd485b-5bb8-4401-a0d2-a019b6afebf6 service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:20.716523 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 521/1039] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:21.633666 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf77f7b-7514-447b-b691-afd8e35bcf26 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:21.634258 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf77f7b-7514-447b-b691-afd8e35bcf26 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:21.634258 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf77f7b-7514-447b-b691-afd8e35bcf26 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:21.635657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 519/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:21.641190 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11539-2085-44a5-a51c-bfbe4e1639bb None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:21.642005 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11539-2085-44a5-a51c-bfbe4e1639bb None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:21.642188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11539-2085-44a5-a51c-bfbe4e1639bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:21.674633 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-a9a11539-2085-44a5-a51c-bfbe4e1639bb None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:21.675985 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-a9a11539-2085-44a5-a51c-bfbe4e1639bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:21.686024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 522/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:02:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:02:21.847317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf77f7b-7514-447b-b691-afd8e35bcf26 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:21.862220 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf77f7b-7514-447b-b691-afd8e35bcf26 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:21.867413 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc9a79-57fa-40a7-87c4-7e1ba98d7c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:21.868065 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc9a79-57fa-40a7-87c4-7e1ba98d7c1c service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:21.868347 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc9a79-57fa-40a7-87c4-7e1ba98d7c1c service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:21.868623 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc9a79-57fa-40a7-87c4-7e1ba98d7c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:21.878985 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc9a79-57fa-40a7-87c4-7e1ba98d7c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:21.880646 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc9a79-57fa-40a7-87c4-7e1ba98d7c1c service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:21.891720 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 520/1042] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:22.824070 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cd6f2-5040-44da-bfac-de5399e0a6bf None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:22.824632 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cd6f2-5040-44da-bfac-de5399e0a6bf None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:22.824632 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cd6f2-5040-44da-bfac-de5399e0a6bf None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:22.826035 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 523/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 19:02:22.831470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965d8c9-197c-4dae-8920-9f6c5f2ff26b None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:22.832002 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965d8c9-197c-4dae-8920-9f6c5f2ff26b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:22.832154 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965d8c9-197c-4dae-8920-9f6c5f2ff26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:22.857992 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-e965d8c9-197c-4dae-8920-9f6c5f2ff26b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:22.859270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-e965d8c9-197c-4dae-8920-9f6c5f2ff26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:22.867818 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 521/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:02:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:23.032700 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cd6f2-5040-44da-bfac-de5399e0a6bf None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:23.047262 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cd6f2-5040-44da-bfac-de5399e0a6bf None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:23.053127 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b80ca-f5dc-4580-ab8c-15c2d153c685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:23.053908 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b80ca-f5dc-4580-ab8c-15c2d153c685 service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:23.054197 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b80ca-f5dc-4580-ab8c-15c2d153c685 service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:23.054477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b80ca-f5dc-4580-ab8c-15c2d153c685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:23.065658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b80ca-f5dc-4580-ab8c-15c2d153c685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:23.067372 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b80ca-f5dc-4580-ab8c-15c2d153c685 service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:23.079240 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 524/1045] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:02:23.958843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6770ea9-4b29-46d5-a8dd-fa5e295555ae None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:23.959444 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6770ea9-4b29-46d5-a8dd-fa5e295555ae None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:23.959602 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6770ea9-4b29-46d5-a8dd-fa5e295555ae None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:23.961840 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 522/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:23.968015 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba24d-daea-4ba2-8b35-c686c4c6bd1c None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:23.968516 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba24d-daea-4ba2-8b35-c686c4c6bd1c None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:23.968648 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba24d-daea-4ba2-8b35-c686c4c6bd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:23.999923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-3c7ba24d-daea-4ba2-8b35-c686c4c6bd1c None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:24.001230 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-3c7ba24d-daea-4ba2-8b35-c686c4c6bd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:24.009749 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 525/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:02:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:02:24.178935 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6770ea9-4b29-46d5-a8dd-fa5e295555ae None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:24.193998 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6770ea9-4b29-46d5-a8dd-fa5e295555ae None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:24.199165 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3be57-8e9e-4a4d-b0d7-d106c3300dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:24.199812 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3be57-8e9e-4a4d-b0d7-d106c3300dc2 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:24.200099 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3be57-8e9e-4a4d-b0d7-d106c3300dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:24.200377 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3be57-8e9e-4a4d-b0d7-d106c3300dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:24.209648 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3be57-8e9e-4a4d-b0d7-d106c3300dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:24.211192 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3be57-8e9e-4a4d-b0d7-d106c3300dc2 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:24.221754 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 523/1048] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:02:25.060858 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be1088-b207-406d-907a-50aaae47726d None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:25.061581 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be1088-b207-406d-907a-50aaae47726d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:25.061581 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be1088-b207-406d-907a-50aaae47726d None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:25.062743 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 526/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 19:02:25.069223 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb9bc-6b9b-44a3-b43f-7c2efb9942e3 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:25.069729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb9bc-6b9b-44a3-b43f-7c2efb9942e3 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:25.070067 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb9bc-6b9b-44a3-b43f-7c2efb9942e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:25.098740 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-48cfb9bc-6b9b-44a3-b43f-7c2efb9942e3 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:25.100901 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-48cfb9bc-6b9b-44a3-b43f-7c2efb9942e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:25.115486 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 524/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:02:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:25.276735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be1088-b207-406d-907a-50aaae47726d None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:25.290905 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be1088-b207-406d-907a-50aaae47726d None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:25.296925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45d999-7a7a-4115-b1e3-5f66cc4813ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:25.297587 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d999-7a7a-4115-b1e3-5f66cc4813ef service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:25.297869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d999-7a7a-4115-b1e3-5f66cc4813ef service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:25.298143 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d999-7a7a-4115-b1e3-5f66cc4813ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:25.310757 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45d999-7a7a-4115-b1e3-5f66cc4813ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:25.312649 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45d999-7a7a-4115-b1e3-5f66cc4813ef service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:25.324391 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 527/1051] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:26.179310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f65a4-ac1b-4672-bf33-20ff7c2b6eca None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:26.179876 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f65a4-ac1b-4672-bf33-20ff7c2b6eca None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:26.179876 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f65a4-ac1b-4672-bf33-20ff7c2b6eca None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:26.181232 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 525/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:26.186822 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265b1e-e9cc-433b-83e8-2c155f5d701d None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:26.187413 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265b1e-e9cc-433b-83e8-2c155f5d701d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:26.187578 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265b1e-e9cc-433b-83e8-2c155f5d701d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:26.211075 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-79265b1e-e9cc-433b-83e8-2c155f5d701d None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:26.212356 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-79265b1e-e9cc-433b-83e8-2c155f5d701d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:26.221461 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 528/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:02:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:26.381676 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f65a4-ac1b-4672-bf33-20ff7c2b6eca None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:26.396918 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f65a4-ac1b-4672-bf33-20ff7c2b6eca None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:26.402137 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda019b-59fc-4a7e-84f3-b74025b63cc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:26.402792 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda019b-59fc-4a7e-84f3-b74025b63cc0 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:26.403075 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda019b-59fc-4a7e-84f3-b74025b63cc0 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:26.403380 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda019b-59fc-4a7e-84f3-b74025b63cc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:26.415492 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda019b-59fc-4a7e-84f3-b74025b63cc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:26.417157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda019b-59fc-4a7e-84f3-b74025b63cc0 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:26.430382 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 526/1054] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:27.293884 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6988204-5334-41f4-a9f6-04da2091a341 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:27.294462 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6988204-5334-41f4-a9f6-04da2091a341 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:27.294462 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6988204-5334-41f4-a9f6-04da2091a341 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:27.295923 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 529/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:27.301573 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249444a6-9f32-4cd5-b5f4-9cfbed3a0187 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:27.302082 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249444a6-9f32-4cd5-b5f4-9cfbed3a0187 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:27.302194 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249444a6-9f32-4cd5-b5f4-9cfbed3a0187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:27.329919 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-249444a6-9f32-4cd5-b5f4-9cfbed3a0187 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:27.331944 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-249444a6-9f32-4cd5-b5f4-9cfbed3a0187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:27.344857 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 527/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:02:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:27.542307 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6988204-5334-41f4-a9f6-04da2091a341 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:27.557090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6988204-5334-41f4-a9f6-04da2091a341 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:27.563201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2aeb6-e4d9-452a-843c-add70628720f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:27.563880 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2aeb6-e4d9-452a-843c-add70628720f service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:27.564157 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2aeb6-e4d9-452a-843c-add70628720f service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:27.564504 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2aeb6-e4d9-452a-843c-add70628720f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:27.575104 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2aeb6-e4d9-452a-843c-add70628720f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:27.577363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2aeb6-e4d9-452a-843c-add70628720f service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:27.588527 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 530/1057] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:29.805470 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3fb7e-e73c-4c0b-bf0b-80e74447eb76 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:29.806437 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3fb7e-e73c-4c0b-bf0b-80e74447eb76 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:29.806437 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3fb7e-e73c-4c0b-bf0b-80e74447eb76 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:29.807416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 528/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:29.813233 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fae732-8893-498f-bf0e-ca99b1cf1e97 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:29.813747 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fae732-8893-498f-bf0e-ca99b1cf1e97 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:29.813945 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fae732-8893-498f-bf0e-ca99b1cf1e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:29.833598 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-01fae732-8893-498f-bf0e-ca99b1cf1e97 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:29.834822 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-01fae732-8893-498f-bf0e-ca99b1cf1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:29.843853 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 531/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:29.885026 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3fb7e-e73c-4c0b-bf0b-80e74447eb76 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:29.896348 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3fb7e-e73c-4c0b-bf0b-80e74447eb76 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:29.900546 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9332f8-56ae-46d4-9790-43b8fcd28dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:29.901192 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9332f8-56ae-46d4-9790-43b8fcd28dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:29.901476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9332f8-56ae-46d4-9790-43b8fcd28dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:29.901752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9332f8-56ae-46d4-9790-43b8fcd28dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:29.912624 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9332f8-56ae-46d4-9790-43b8fcd28dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:29.914074 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9332f8-56ae-46d4-9790-43b8fcd28dc0 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:29.924809 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 529/1060] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:32.398836 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64ecd0-3702-4f1c-a3ef-b6df56fb58e2 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:32.399398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64ecd0-3702-4f1c-a3ef-b6df56fb58e2 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:32.399398 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64ecd0-3702-4f1c-a3ef-b6df56fb58e2 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:32.400695 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 532/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:32.406487 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70149302-20e6-4c3a-98fc-00cbb2d59547 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:32.407021 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70149302-20e6-4c3a-98fc-00cbb2d59547 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:32.407021 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70149302-20e6-4c3a-98fc-00cbb2d59547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:32.427088 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-70149302-20e6-4c3a-98fc-00cbb2d59547 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:32.428352 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-70149302-20e6-4c3a-98fc-00cbb2d59547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:32.437000 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 530/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:32.477304 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64ecd0-3702-4f1c-a3ef-b6df56fb58e2 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:32.489528 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64ecd0-3702-4f1c-a3ef-b6df56fb58e2 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:32.493081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa5c21-e531-4407-bc18-2bad89090a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:32.493720 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa5c21-e531-4407-bc18-2bad89090a43 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:32.494000 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa5c21-e531-4407-bc18-2bad89090a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:32.494272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa5c21-e531-4407-bc18-2bad89090a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:32.505859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa5c21-e531-4407-bc18-2bad89090a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:32.507338 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa5c21-e531-4407-bc18-2bad89090a43 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:32.518686 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 533/1063] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:02:35.140775 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c97e8-8d0f-4759-bd04-c366bd6aebac None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:35.141304 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c97e8-8d0f-4759-bd04-c366bd6aebac None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:35.141304 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c97e8-8d0f-4759-bd04-c366bd6aebac None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:35.142609 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 531/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:35.148063 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984f2f9-359f-46f5-8816-39f938495342 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:35.148557 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984f2f9-359f-46f5-8816-39f938495342 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:35.148670 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984f2f9-359f-46f5-8816-39f938495342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:35.168703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-6984f2f9-359f-46f5-8816-39f938495342 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:35.170833 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-6984f2f9-359f-46f5-8816-39f938495342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:35.178972 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 534/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:35.221604 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c97e8-8d0f-4759-bd04-c366bd6aebac None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:35.233117 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c97e8-8d0f-4759-bd04-c366bd6aebac None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:35.237121 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ac855-4966-4681-b179-04a1316db686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:35.237752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac855-4966-4681-b179-04a1316db686 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:35.238034 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac855-4966-4681-b179-04a1316db686 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:35.238307 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac855-4966-4681-b179-04a1316db686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:35.247184 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ac855-4966-4681-b179-04a1316db686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:35.249370 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ac855-4966-4681-b179-04a1316db686 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:35.258854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 532/1066] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:37.608613 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b1fe-c075-4e44-90dc-424f91a94cea None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:37.609191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b1fe-c075-4e44-90dc-424f91a94cea None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:37.609191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b1fe-c075-4e44-90dc-424f91a94cea None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:37.610508 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 535/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:37.616012 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58860e2-ecc5-4df3-8f66-5e8ab5720256 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:37.616418 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58860e2-ecc5-4df3-8f66-5e8ab5720256 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:37.616566 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58860e2-ecc5-4df3-8f66-5e8ab5720256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:37.635522 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-c58860e2-ecc5-4df3-8f66-5e8ab5720256 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:37.636702 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-c58860e2-ecc5-4df3-8f66-5e8ab5720256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:37.645006 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 533/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:37.684788 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3b1fe-c075-4e44-90dc-424f91a94cea None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:37.695412 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3b1fe-c075-4e44-90dc-424f91a94cea None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:37.698847 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014729ef-81a3-4358-9b33-c7c48eb1c8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:37.699512 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014729ef-81a3-4358-9b33-c7c48eb1c8eb service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:37.699799 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014729ef-81a3-4358-9b33-c7c48eb1c8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:37.700608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014729ef-81a3-4358-9b33-c7c48eb1c8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:37.709597 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014729ef-81a3-4358-9b33-c7c48eb1c8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:37.711037 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014729ef-81a3-4358-9b33-c7c48eb1c8eb service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:37.720983 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 536/1069] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:40.025069 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755399d-03a8-4ad8-9fbb-441c2f94e874 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:40.025623 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755399d-03a8-4ad8-9fbb-441c2f94e874 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:40.025623 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755399d-03a8-4ad8-9fbb-441c2f94e874 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:40.026897 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 534/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:40.032140 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c60a6-daf6-49d0-8e78-af115c23d80b None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:40.032574 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c60a6-daf6-49d0-8e78-af115c23d80b None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:40.032710 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c60a6-daf6-49d0-8e78-af115c23d80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:40.052651 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-868c60a6-daf6-49d0-8e78-af115c23d80b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:40.053867 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-868c60a6-daf6-49d0-8e78-af115c23d80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:40.062271 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 537/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:40.100610 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755399d-03a8-4ad8-9fbb-441c2f94e874 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:40.111957 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755399d-03a8-4ad8-9fbb-441c2f94e874 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:40.115413 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96058-847e-427b-b98e-8fb59fc18f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:40.116051 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96058-847e-427b-b98e-8fb59fc18f45 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:40.116339 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96058-847e-427b-b98e-8fb59fc18f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:40.116621 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96058-847e-427b-b98e-8fb59fc18f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:40.126568 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96058-847e-427b-b98e-8fb59fc18f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:40.128031 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96058-847e-427b-b98e-8fb59fc18f45 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:40.137298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 535/1072] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:42.439843 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b80e0d-787c-4f1a-a073-e9dd52fb7f86 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:42.440350 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b80e0d-787c-4f1a-a073-e9dd52fb7f86 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:42.440350 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b80e0d-787c-4f1a-a073-e9dd52fb7f86 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:42.441677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 538/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:42.447009 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3e54-8633-40b4-bd58-21e7be8a3a2d None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:42.447408 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3e54-8633-40b4-bd58-21e7be8a3a2d None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:42.447612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3e54-8633-40b4-bd58-21e7be8a3a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:42.455680 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=70 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:02:42.468518 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-25ca3e54-8633-40b4-bd58-21e7be8a3a2d None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:42.469713 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-25ca3e54-8633-40b4-bd58-21e7be8a3a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:42.477967 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 536/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:42.517870 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b80e0d-787c-4f1a-a073-e9dd52fb7f86 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:42.523178 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=64 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:02:42.530138 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b80e0d-787c-4f1a-a073-e9dd52fb7f86 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:42.533608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fa3d7-fb05-43da-9ee8-a67d97881416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:42.534241 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fa3d7-fb05-43da-9ee8-a67d97881416 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:42.534525 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fa3d7-fb05-43da-9ee8-a67d97881416 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:42.534799 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fa3d7-fb05-43da-9ee8-a67d97881416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:42.544708 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fa3d7-fb05-43da-9ee8-a67d97881416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:42.546165 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fa3d7-fb05-43da-9ee8-a67d97881416 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:42.555695 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 539/1075] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:44.871835 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c1412-32bb-4830-aedb-ff51cef67196 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:44.872657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c1412-32bb-4830-aedb-ff51cef67196 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:44.872657 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c1412-32bb-4830-aedb-ff51cef67196 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:44.874287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 537/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:44.879613 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f04c-3448-41c4-b7af-4549e9e4e8a0 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:44.880021 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f04c-3448-41c4-b7af-4549e9e4e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:44.880180 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f04c-3448-41c4-b7af-4549e9e4e8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:44.899477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-5102f04c-3448-41c4-b7af-4549e9e4e8a0 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:44.900687 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-5102f04c-3448-41c4-b7af-4549e9e4e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:44.909428 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 540/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:44.947757 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c1412-32bb-4830-aedb-ff51cef67196 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:44.958684 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c1412-32bb-4830-aedb-ff51cef67196 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:44.962143 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b817eed-5be2-4391-a0cc-b068d99e7eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:44.962780 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b817eed-5be2-4391-a0cc-b068d99e7eac service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:44.963066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b817eed-5be2-4391-a0cc-b068d99e7eac service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:44.963384 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b817eed-5be2-4391-a0cc-b068d99e7eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:44.972900 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b817eed-5be2-4391-a0cc-b068d99e7eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:44.974402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b817eed-5be2-4391-a0cc-b068d99e7eac service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:44.984306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 538/1078] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:47.262801 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187cca8-c43b-4e15-8f41-c8f680a9e4e4 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:47.263453 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187cca8-c43b-4e15-8f41-c8f680a9e4e4 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:47.263453 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187cca8-c43b-4e15-8f41-c8f680a9e4e4 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:47.264824 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 541/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:47.270018 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ed37b-6adb-49eb-9339-16fd93234d5e None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:47.270454 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ed37b-6adb-49eb-9339-16fd93234d5e None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:47.270583 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ed37b-6adb-49eb-9339-16fd93234d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:47.290153 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-f29ed37b-6adb-49eb-9339-16fd93234d5e None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:47.291372 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-f29ed37b-6adb-49eb-9339-16fd93234d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:47.300258 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 539/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:47.340253 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187cca8-c43b-4e15-8f41-c8f680a9e4e4 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:47.352467 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187cca8-c43b-4e15-8f41-c8f680a9e4e4 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:47.356658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95b239-9f8f-41c6-b73a-bf9b1520d0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:47.357420 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95b239-9f8f-41c6-b73a-bf9b1520d0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:47.357706 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95b239-9f8f-41c6-b73a-bf9b1520d0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:47.357984 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95b239-9f8f-41c6-b73a-bf9b1520d0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:47.367344 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95b239-9f8f-41c6-b73a-bf9b1520d0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:47.368800 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95b239-9f8f-41c6-b73a-bf9b1520d0a6 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:47.379912 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 542/1081] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:49.630226 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a00ab-05f1-45d4-9d4f-0c02c9245cd1 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:49.630791 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a00ab-05f1-45d4-9d4f-0c02c9245cd1 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:49.630791 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a00ab-05f1-45d4-9d4f-0c02c9245cd1 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:49.632189 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 540/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:49.637328 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df176ef9-dba6-486b-9ea7-823d73f856cf None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:49.637767 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df176ef9-dba6-486b-9ea7-823d73f856cf None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:49.637872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df176ef9-dba6-486b-9ea7-823d73f856cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:49.657679 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-df176ef9-dba6-486b-9ea7-823d73f856cf None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:49.658873 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-df176ef9-dba6-486b-9ea7-823d73f856cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:49.666825 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 543/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:49.705013 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a00ab-05f1-45d4-9d4f-0c02c9245cd1 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:49.716177 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a00ab-05f1-45d4-9d4f-0c02c9245cd1 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:49.719712 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf217f5-f720-49d7-a876-6129a98e1dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:49.720343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf217f5-f720-49d7-a876-6129a98e1dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:49.720647 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf217f5-f720-49d7-a876-6129a98e1dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:49.720910 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf217f5-f720-49d7-a876-6129a98e1dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:49.729690 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf217f5-f720-49d7-a876-6129a98e1dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:49.731768 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf217f5-f720-49d7-a876-6129a98e1dd7 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:49.741173 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 541/1084] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:02:51.972498 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ab71-e2c1-40fd-81c2-f250765cf131 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:51.973029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ab71-e2c1-40fd-81c2-f250765cf131 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:51.973029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ab71-e2c1-40fd-81c2-f250765cf131 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:51.974336 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 544/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:02:51.979516 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217744a-6436-402e-bb23-a25c11ddbc29 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:51.979929 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217744a-6436-402e-bb23-a25c11ddbc29 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:51.980073 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217744a-6436-402e-bb23-a25c11ddbc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:52.000135 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-1217744a-6436-402e-bb23-a25c11ddbc29 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:02:52.001331 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-1217744a-6436-402e-bb23-a25c11ddbc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:02:52.009002 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 542/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:02:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:02:52.047664 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617ab71-e2c1-40fd-81c2-f250765cf131 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:02:52.061238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617ab71-e2c1-40fd-81c2-f250765cf131 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:02:52.066319 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc65f3-1796-4e53-a366-75036aacc417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:02:52.066955 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc65f3-1796-4e53-a366-75036aacc417 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:02:52.067283 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc65f3-1796-4e53-a366-75036aacc417 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:02:52.067568 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc65f3-1796-4e53-a366-75036aacc417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:02:52.077023 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc65f3-1796-4e53-a366-75036aacc417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:02:52.078460 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc65f3-1796-4e53-a366-75036aacc417 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:02:52.087929 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 545/1087] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:02:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:03:01.994667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=20 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:03:02.083640 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=23 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:03:16.273286 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781711-abd4-4623-aa17-d3c86d00f98a None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:16.273832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781711-abd4-4623-aa17-d3c86d00f98a None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:16.273832 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781711-abd4-4623-aa17-d3c86d00f98a None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:16.275245 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 543/1088] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:03:16.280392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af9f0-b558-42c9-9d67-61c8c729eb04 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:16.280993 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af9f0-b558-42c9-9d67-61c8c729eb04 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:16.280993 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af9f0-b558-42c9-9d67-61c8c729eb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:16.306333 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-943af9f0-b558-42c9-9d67-61c8c729eb04 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:03:16.307588 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-943af9f0-b558-42c9-9d67-61c8c729eb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:03:16.316142 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 546/1089] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:03:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:03:16.366616 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9438f-09c9-415c-a981-bf81d668d744 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:16.366911 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9438f-09c9-415c-a981-bf81d668d744 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:16.367229 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9438f-09c9-415c-a981-bf81d668d744 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:16.368619 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 544/1090] 10.222.0.98 () {54 vars in 966 bytes} [Mon Jul 25 19:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:03:16.374129 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960304-58b7-4194-b076-52e7648c19dd None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:16.374425 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960304-58b7-4194-b076-52e7648c19dd None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:16.374706 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960304-58b7-4194-b076-52e7648c19dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:16.394679 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-3c960304-58b7-4194-b076-52e7648c19dd None None] MFA Rules not processed for user `1e21b5991e7345149a4d0e644a436099`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:03:16.395980 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-3c960304-58b7-4194-b076-52e7648c19dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:03:16.403116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 547/1091] 10.222.0.98 () {58 vars in 1063 bytes} [Mon Jul 25 19:03:16 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:03:16.410634 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9438f-09c9-415c-a981-bf81d668d744 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:03:16.422264 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9438f-09c9-415c-a981-bf81d668d744 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:03:16.426986 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b8bcd-9ea8-414a-b7c5-23401b516092 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e21b5991e7345149a4d0e644a436099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:03:16.427752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b8bcd-9ea8-414a-b7c5-23401b516092 service glance] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:16.428032 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b8bcd-9ea8-414a-b7c5-23401b516092 service glance] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:16.428306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b8bcd-9ea8-414a-b7c5-23401b516092 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:16.440889 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b8bcd-9ea8-414a-b7c5-23401b516092 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:03:16.442331 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b8bcd-9ea8-414a-b7c5-23401b516092 service glance] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:03:16.453312 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 545/1092] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:03:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:03:18.885236 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd652-4bd7-4f0a-acbd-7a95cf789180 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:18.885852 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd652-4bd7-4f0a-acbd-7a95cf789180 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:18.885852 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd652-4bd7-4f0a-acbd-7a95cf789180 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:18.887956 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 548/1093] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 19:03:18.893762 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609cc33-0032-4f56-a493-8b8c8d054b9e None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:18.894227 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609cc33-0032-4f56-a493-8b8c8d054b9e None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:18.894356 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609cc33-0032-4f56-a493-8b8c8d054b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:18.916256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-8609cc33-0032-4f56-a493-8b8c8d054b9e None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:03:18.917456 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-8609cc33-0032-4f56-a493-8b8c8d054b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:03:18.925648 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 546/1094] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:03:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:03:18.951099 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dd652-4bd7-4f0a-acbd-7a95cf789180 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:03:18.963947 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dd652-4bd7-4f0a-acbd-7a95cf789180 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:03:18.969255 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c40c55-955b-47a9-b68c-7b0eb57a1d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:03:18.969953 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40c55-955b-47a9-b68c-7b0eb57a1d23 admin admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:18.970240 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40c55-955b-47a9-b68c-7b0eb57a1d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:18.970515 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40c55-955b-47a9-b68c-7b0eb57a1d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:18.971309 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c40c55-955b-47a9-b68c-7b0eb57a1d23 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:03:18.973123 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: WARNING py.warnings [None req-19c40c55-955b-47a9-b68c-7b0eb57a1d23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:03:18.973123 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: warnings.warn(msg) Jul 25 19:03:18.973123 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: Jul 25 19:03:18.974277 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c40c55-955b-47a9-b68c-7b0eb57a1d23 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:03:18.994297 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 549/1095] 10.222.0.98 () {56 vars in 1108 bytes} [Mon Jul 25 19:03:18 2022] GET /identity/v3/projects => generated 1606 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:03:21.284290 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3143b2-5840-47f7-81ae-2a46f30aafa3 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:21.284866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3143b2-5840-47f7-81ae-2a46f30aafa3 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:21.284866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3143b2-5840-47f7-81ae-2a46f30aafa3 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:21.286235 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 547/1096] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:03:21.291404 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b059a7-9ee2-4320-b00a-e475dcea3e13 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:21.291832 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b059a7-9ee2-4320-b00a-e475dcea3e13 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:21.292011 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b059a7-9ee2-4320-b00a-e475dcea3e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:21.311904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-e8b059a7-9ee2-4320-b00a-e475dcea3e13 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:03:21.313141 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-e8b059a7-9ee2-4320-b00a-e475dcea3e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:03:21.320994 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 550/1097] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:03:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:03:21.368242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3143b2-5840-47f7-81ae-2a46f30aafa3 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:03:21.382304 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3143b2-5840-47f7-81ae-2a46f30aafa3 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:03:21.387819 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14105bfc-772a-4014-95a3-d9c84d8e6d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:03:21.388463 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14105bfc-772a-4014-95a3-d9c84d8e6d87 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:21.388753 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14105bfc-772a-4014-95a3-d9c84d8e6d87 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:21.389034 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14105bfc-772a-4014-95a3-d9c84d8e6d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:21.397346 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14105bfc-772a-4014-95a3-d9c84d8e6d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:03:21.398924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14105bfc-772a-4014-95a3-d9c84d8e6d87 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:03:21.409385 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 548/1098] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:03:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:03:23.857793 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4796a5d-0785-4d45-b563-7facc65a8cc9 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:23.858367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4796a5d-0785-4d45-b563-7facc65a8cc9 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:23.858367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4796a5d-0785-4d45-b563-7facc65a8cc9 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:23.859740 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 551/1099] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:03:23.864911 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395381f3-eeda-449f-8619-3e129c195413 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:23.865317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395381f3-eeda-449f-8619-3e129c195413 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:23.865468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395381f3-eeda-449f-8619-3e129c195413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:23.885416 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-395381f3-eeda-449f-8619-3e129c195413 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:03:23.887365 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-395381f3-eeda-449f-8619-3e129c195413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:03:23.895730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 549/1100] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:03:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:03:23.935255 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4796a5d-0785-4d45-b563-7facc65a8cc9 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:03:23.946300 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4796a5d-0785-4d45-b563-7facc65a8cc9 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:03:23.950771 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7ae2a-f3f6-4dbc-a114-f5261c05ea9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:03:23.951540 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7ae2a-f3f6-4dbc-a114-f5261c05ea9e service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:23.951831 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7ae2a-f3f6-4dbc-a114-f5261c05ea9e service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:23.952106 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7ae2a-f3f6-4dbc-a114-f5261c05ea9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:23.961658 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7ae2a-f3f6-4dbc-a114-f5261c05ea9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:03:23.963152 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7ae2a-f3f6-4dbc-a114-f5261c05ea9e service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:03:23.973447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 552/1101] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:03:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:03:26.314373 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7e37-11bb-48ae-9bf6-2eb80f1d283a None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:26.314936 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7e37-11bb-48ae-9bf6-2eb80f1d283a None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:26.314936 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7e37-11bb-48ae-9bf6-2eb80f1d283a None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:26.316393 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 550/1102] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:03:26.321897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b01d9-335a-4ee0-891d-7bc5fe3444c3 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:26.322405 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b01d9-335a-4ee0-891d-7bc5fe3444c3 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:26.322520 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b01d9-335a-4ee0-891d-7bc5fe3444c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:26.343887 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-329b01d9-335a-4ee0-891d-7bc5fe3444c3 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:03:26.345107 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-329b01d9-335a-4ee0-891d-7bc5fe3444c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:03:26.352820 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 553/1103] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:03:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:03:26.393736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb7e37-11bb-48ae-9bf6-2eb80f1d283a None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:03:26.404677 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb7e37-11bb-48ae-9bf6-2eb80f1d283a None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:03:26.408190 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d416e-fdb7-44f7-859d-96403f87b5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:03:26.408838 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d416e-fdb7-44f7-859d-96403f87b5ca service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:26.409126 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d416e-fdb7-44f7-859d-96403f87b5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:26.409406 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d416e-fdb7-44f7-859d-96403f87b5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:26.419433 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d416e-fdb7-44f7-859d-96403f87b5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:03:26.420924 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d416e-fdb7-44f7-859d-96403f87b5ca service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:03:26.430928 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 551/1104] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:03:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:03:28.894860 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869487d-7c35-4a19-9b1d-73b69ec77bad None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:28.895444 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869487d-7c35-4a19-9b1d-73b69ec77bad None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:28.895547 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869487d-7c35-4a19-9b1d-73b69ec77bad None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:28.896893 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 554/1105] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:03:28.902944 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19b318-86ea-4939-97a6-3ae059b2c31c None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:28.903438 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19b318-86ea-4939-97a6-3ae059b2c31c None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:28.903536 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19b318-86ea-4939-97a6-3ae059b2c31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:28.922434 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-be19b318-86ea-4939-97a6-3ae059b2c31c None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:03:28.923670 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-be19b318-86ea-4939-97a6-3ae059b2c31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:03:28.931263 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 552/1106] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:03:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:03:28.973155 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869487d-7c35-4a19-9b1d-73b69ec77bad None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:03:28.984927 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869487d-7c35-4a19-9b1d-73b69ec77bad None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:03:28.988494 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f04898-48f9-4d79-80a0-7969388436aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:03:28.989137 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f04898-48f9-4d79-80a0-7969388436aa service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:28.989427 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f04898-48f9-4d79-80a0-7969388436aa service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:28.989707 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f04898-48f9-4d79-80a0-7969388436aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:28.999928 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f04898-48f9-4d79-80a0-7969388436aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:03:29.001385 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f04898-48f9-4d79-80a0-7969388436aa service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:03:29.011370 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 555/1107] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:03:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:03:31.408047 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9c34b-cd71-43a2-869c-cc8be0d52596 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:31.408608 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9c34b-cd71-43a2-869c-cc8be0d52596 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:31.408608 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9c34b-cd71-43a2-869c-cc8be0d52596 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:31.409975 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 553/1108] 10.222.0.98 () {54 vars in 926 bytes} [Mon Jul 25 19:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:03:31.415225 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689429ce-93ff-4e03-aa3a-af2f2b6f9f1b None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:31.415641 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689429ce-93ff-4e03-aa3a-af2f2b6f9f1b None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:31.415784 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689429ce-93ff-4e03-aa3a-af2f2b6f9f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:31.435024 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-689429ce-93ff-4e03-aa3a-af2f2b6f9f1b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:03:31.436233 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-689429ce-93ff-4e03-aa3a-af2f2b6f9f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:03:31.443972 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 556/1109] 10.222.0.98 () {58 vars in 1023 bytes} [Mon Jul 25 19:03:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:03:31.483479 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9c34b-cd71-43a2-869c-cc8be0d52596 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:03:31.494227 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9c34b-cd71-43a2-869c-cc8be0d52596 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:03:31.498990 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d20ca-8f14-452e-b6cc-de104635eab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:03:31.500262 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d20ca-8f14-452e-b6cc-de104635eab6 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:03:31.500262 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d20ca-8f14-452e-b6cc-de104635eab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:03:31.501244 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d20ca-8f14-452e-b6cc-de104635eab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:03:31.511298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d20ca-8f14-452e-b6cc-de104635eab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:03:31.512877 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d20ca-8f14-452e-b6cc-de104635eab6 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:03:31.522332 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 554/1110] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:03:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:03:41.429975 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=33 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:03:41.518119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=33 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:09.684565 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63378f-25f9-4293-9b2c-f0be2717c611 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.686996 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63378f-25f9-4293-9b2c-f0be2717c611 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.686996 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63378f-25f9-4293-9b2c-f0be2717c611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.715533 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-ba63378f-25f9-4293-9b2c-f0be2717c611 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:09.717126 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-ba63378f-25f9-4293-9b2c-f0be2717c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:09.729855 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 557/1111] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:05:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:05:09.738650 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e36c6c-67cd-4803-8f4e-69e2d7531ce7 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.739549 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e36c6c-67cd-4803-8f4e-69e2d7531ce7 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.739717 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e36c6c-67cd-4803-8f4e-69e2d7531ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.769244 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-87e36c6c-67cd-4803-8f4e-69e2d7531ce7 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:09.770003 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-87e36c6c-67cd-4803-8f4e-69e2d7531ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:09.779012 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 555/1112] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:05:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:05:09.785160 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63378f-25f9-4293-9b2c-f0be2717c611 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:09.795328 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63378f-25f9-4293-9b2c-f0be2717c611 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:09.800378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3caa04-6915-4359-b874-85de5a653636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:09.801038 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3caa04-6915-4359-b874-85de5a653636 admin admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.801316 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3caa04-6915-4359-b874-85de5a653636 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.801595 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3caa04-6915-4359-b874-85de5a653636 admin admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.802320 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3caa04-6915-4359-b874-85de5a653636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:09.802617 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3caa04-6915-4359-b874-85de5a653636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:09.803776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: WARNING py.warnings [None req-fc3caa04-6915-4359-b874-85de5a653636 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:05:09.803776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: warnings.warn(msg) Jul 25 19:05:09.803776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: Jul 25 19:05:09.804668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3caa04-6915-4359-b874-85de5a653636 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:09.826898 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 558/1113] 10.222.0.98 () {58 vars in 1153 bytes} [Mon Jul 25 19:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:09.838538 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e36c6c-67cd-4803-8f4e-69e2d7531ce7 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:09.851536 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e36c6c-67cd-4803-8f4e-69e2d7531ce7 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:09.858806 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ffc6a-056a-4630-b99f-b4fedd983cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:09.859759 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ffc6a-056a-4630-b99f-b4fedd983cdb admin admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.860035 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ffc6a-056a-4630-b99f-b4fedd983cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.860369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ffc6a-056a-4630-b99f-b4fedd983cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.861508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ffc6a-056a-4630-b99f-b4fedd983cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:09.864275 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: WARNING py.warnings [None req-782ffc6a-056a-4630-b99f-b4fedd983cdb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:05:09.864275 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: warnings.warn(msg) Jul 25 19:05:09.864275 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: Jul 25 19:05:09.867031 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ffc6a-056a-4630-b99f-b4fedd983cdb admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:09.905523 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 556/1114] 10.222.0.98 () {60 vars in 1153 bytes} [Mon Jul 25 19:05:09 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:09.911770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3caa04-6915-4359-b874-85de5a653636 admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:09.925965 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3caa04-6915-4359-b874-85de5a653636 admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:09.994226 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54da1-5d31-4110-b4f1-a9df472ed48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:09.994897 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54da1-5d31-4110-b4f1-a9df472ed48a admin admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.995216 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54da1-5d31-4110-b4f1-a9df472ed48a admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.995491 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54da1-5d31-4110-b4f1-a9df472ed48a admin admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.996173 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a54da1-5d31-4110-b4f1-a9df472ed48a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:09.997211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: WARNING py.warnings [None req-d1a54da1-5d31-4110-b4f1-a9df472ed48a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:05:09.997211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: warnings.warn(msg) Jul 25 19:05:09.997211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: Jul 25 19:05:09.998458 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a54da1-5d31-4110-b4f1-a9df472ed48a admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.029911 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 559/1115] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 19:05:09 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:10.035193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ffc6a-056a-4630-b99f-b4fedd983cdb admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:10.047301 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ffc6a-056a-4630-b99f-b4fedd983cdb admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.052002 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df5bdd-d71a-415c-942f-b4f3492fd593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.052674 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df5bdd-d71a-415c-942f-b4f3492fd593 admin admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.052956 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df5bdd-d71a-415c-942f-b4f3492fd593 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.053309 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df5bdd-d71a-415c-942f-b4f3492fd593 admin admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.054165 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df5bdd-d71a-415c-942f-b4f3492fd593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.055205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: WARNING py.warnings [None req-92df5bdd-d71a-415c-942f-b4f3492fd593 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:05:10.055205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: warnings.warn(msg) Jul 25 19:05:10.055205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: Jul 25 19:05:10.056190 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df5bdd-d71a-415c-942f-b4f3492fd593 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.070952 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 557/1116] 10.222.0.98 () {58 vars in 1122 bytes} [Mon Jul 25 19:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:05:10.076731 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54da1-5d31-4110-b4f1-a9df472ed48a admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:10.093373 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54da1-5d31-4110-b4f1-a9df472ed48a admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.100770 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0202b93-4c22-4e69-95b0-f033a31b6beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.101902 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0202b93-4c22-4e69-95b0-f033a31b6beb admin admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.102864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0202b93-4c22-4e69-95b0-f033a31b6beb admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.102864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0202b93-4c22-4e69-95b0-f033a31b6beb admin admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.104266 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0202b93-4c22-4e69-95b0-f033a31b6beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.106118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: WARNING py.warnings [None req-b0202b93-4c22-4e69-95b0-f033a31b6beb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:05:10.106118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: warnings.warn(msg) Jul 25 19:05:10.106118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: Jul 25 19:05:10.107791 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0202b93-4c22-4e69-95b0-f033a31b6beb admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.124998 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 560/1117] 10.222.0.98 () {58 vars in 1122 bytes} [Mon Jul 25 19:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:05:10.129447 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df5bdd-d71a-415c-942f-b4f3492fd593 admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:10.146472 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df5bdd-d71a-415c-942f-b4f3492fd593 admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.157468 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d418ea6-9d52-44f9-8931-2534a0554e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.158849 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d418ea6-9d52-44f9-8931-2534a0554e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.159410 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d418ea6-9d52-44f9-8931-2534a0554e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.159806 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d418ea6-9d52-44f9-8931-2534a0554e02 admin admin] PATH_INFO: `/v3/projects/658419fb7fe54bf6be2cc42116d1163a/users/5c16b3b3a4204d98a1c95542579bbe51/roles/7bea6298af7e4980950949b024a1e103` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.180505 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d418ea6-9d52-44f9-8931-2534a0554e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658419fb7fe54bf6be2cc42116d1163a, user_id=5c16b3b3a4204d98a1c95542579bbe51, role_id=7bea6298af7e4980950949b024a1e103)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.181861 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: WARNING py.warnings [None req-5d418ea6-9d52-44f9-8931-2534a0554e02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:05:10.181861 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: warnings.warn(msg) Jul 25 19:05:10.181861 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: Jul 25 19:05:10.184248 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d418ea6-9d52-44f9-8931-2534a0554e02 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.202712 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 558/1118] 10.222.0.98 () {60 vars in 1483 bytes} [Mon Jul 25 19:05:10 2022] PUT /identity/v3/projects/658419fb7fe54bf6be2cc42116d1163a/users/5c16b3b3a4204d98a1c95542579bbe51/roles/7bea6298af7e4980950949b024a1e103 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:05:10.215604 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08c2e0-5405-464c-b76e-d95d0bff8f7b None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.215888 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08c2e0-5405-464c-b76e-d95d0bff8f7b None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.216926 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08c2e0-5405-464c-b76e-d95d0bff8f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.245940 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-7e08c2e0-5405-464c-b76e-d95d0bff8f7b None None] MFA Rules not processed for user `5c16b3b3a4204d98a1c95542579bbe51`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:10.247066 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-7e08c2e0-5405-464c-b76e-d95d0bff8f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:10.321621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 561/1119] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:05:10 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:05:10.336808 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38923c-f62f-4367-b912-0249135515cb None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.337108 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38923c-f62f-4367-b912-0249135515cb None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.337398 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38923c-f62f-4367-b912-0249135515cb None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.338807 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 559/1120] 10.222.0.98 () {54 vars in 964 bytes} [Mon Jul 25 19:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:05:10.345501 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74892-a285-4112-b11d-5bedf4f1f366 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.345948 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74892-a285-4112-b11d-5bedf4f1f366 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.346463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74892-a285-4112-b11d-5bedf4f1f366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.376450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-bbe74892-a285-4112-b11d-5bedf4f1f366 None None] MFA Rules not processed for user `c000c774dc134acabf8abaa701de3be4`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:10.377678 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-bbe74892-a285-4112-b11d-5bedf4f1f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:10.430307 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:10.439226 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 562/1121] 10.222.0.98 () {58 vars in 1061 bytes} [Mon Jul 25 19:05:10 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:05:10.448316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38923c-f62f-4367-b912-0249135515cb None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:10.460266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38923c-f62f-4367-b912-0249135515cb None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.463889 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98022c-8e00-4a10-b939-cd7d68ed1531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c000c774dc134acabf8abaa701de3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.464534 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98022c-8e00-4a10-b939-cd7d68ed1531 service cinder] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.464818 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98022c-8e00-4a10-b939-cd7d68ed1531 service cinder] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.465089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98022c-8e00-4a10-b939-cd7d68ed1531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.474323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98022c-8e00-4a10-b939-cd7d68ed1531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.476615 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98022c-8e00-4a10-b939-cd7d68ed1531 service cinder] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.486283 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 560/1122] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:05:10 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:05:10.526051 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f315a9-f4ee-44c1-b61e-9a63d0703e9b None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.526342 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f315a9-f4ee-44c1-b61e-9a63d0703e9b None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.526621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f315a9-f4ee-44c1-b61e-9a63d0703e9b None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.527958 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 563/1123] 10.222.0.98 () {52 vars in 830 bytes} [Mon Jul 25 19:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:05:10.531684 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98022c-8e00-4a10-b939-cd7d68ed1531 service cinder] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:10.599815 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98022c-8e00-4a10-b939-cd7d68ed1531 service cinder] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.606022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.606891 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.607200 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.607472 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] PATH_INFO: `/v3/users/5c16b3b3a4204d98a1c95542579bbe51` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.608695 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c16b3b3a4204d98a1c95542579bbe51)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.609772 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: WARNING py.warnings [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:05:10.609772 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: warnings.warn(msg) Jul 25 19:05:10.609772 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: Jul 25 19:05:10.611140 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.687076 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c16b3b3a4204d98a1c95542579bbe51'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:05:10.698467 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c16b3b3a4204d98a1c95542579bbe51'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:05:10.711498 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c16b3b3a4204d98a1c95542579bbe51'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:05:10.734268 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c16b3b3a4204d98a1c95542579bbe51'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:05:10.735601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c16b3b3a4204d98a1c95542579bbe51'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:05:10.746031 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 561/1124] 10.222.0.98 () {58 vars in 1224 bytes} [Mon Jul 25 19:05:10 2022] DELETE /identity/v3/users/5c16b3b3a4204d98a1c95542579bbe51 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:10.751162 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d75c7d-4a52-458c-9e7f-22a79b31867f None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.751714 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d75c7d-4a52-458c-9e7f-22a79b31867f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.751918 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d75c7d-4a52-458c-9e7f-22a79b31867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.770680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-81d75c7d-4a52-458c-9e7f-22a79b31867f None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:10.772571 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-81d75c7d-4a52-458c-9e7f-22a79b31867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:10.840653 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 564/1125] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:05:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:05:10.851247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:10.852759 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:10.858903 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:10.943192 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea386d-49da-4370-b37f-583f152acb59 admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.948543 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fedb36-77da-4df2-9ac3-77b8848e1e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.949418 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fedb36-77da-4df2-9ac3-77b8848e1e44 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.949807 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fedb36-77da-4df2-9ac3-77b8848e1e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.950295 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fedb36-77da-4df2-9ac3-77b8848e1e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.960539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fedb36-77da-4df2-9ac3-77b8848e1e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.961976 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fedb36-77da-4df2-9ac3-77b8848e1e44 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.971414 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 562/1126] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:05:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:05:11.361647 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d75c7d-4a52-458c-9e7f-22a79b31867f None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:11.367831 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-81d75c7d-4a52-458c-9e7f-22a79b31867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:11.382044 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d75c7d-4a52-458c-9e7f-22a79b31867f None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:11.388982 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:11.389981 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:11.390132 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:11.390507 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] PATH_INFO: `/v3/projects/658419fb7fe54bf6be2cc42116d1163a` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:11.391678 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=658419fb7fe54bf6be2cc42116d1163a)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:11.392744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: WARNING py.warnings [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:05:11.392744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: warnings.warn(msg) Jul 25 19:05:11.392744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: Jul 25 19:05:11.393928 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:11.476249 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658419fb7fe54bf6be2cc42116d1163a', 'request_id': 'req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:05:11.491510 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658419fb7fe54bf6be2cc42116d1163a', 'request_id': 'req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:05:11.502261 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658419fb7fe54bf6be2cc42116d1163a', 'request_id': 'req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:05:11.519241 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] The token cache is being invalidate because project 658419fb7fe54bf6be2cc42116d1163a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:05:11.519760 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:05:11.520769 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-75a1fd33-f5fa-4b1d-9ffa-3dbad48dc6bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:05:11.524006 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 565/1127] 10.222.0.98 () {58 vars in 1233 bytes} [Mon Jul 25 19:05:11 2022] DELETE /identity/v3/projects/658419fb7fe54bf6be2cc42116d1163a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:20.967499 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=25 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:21.513222 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:44.685364 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094988ad-0edc-45bc-9bd9-3412852faad5 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.685974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094988ad-0edc-45bc-9bd9-3412852faad5 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.685974 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094988ad-0edc-45bc-9bd9-3412852faad5 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.687795 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 563/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:06:44.693642 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e431ae-18f5-4b62-8883-e1d6006ad20b None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.694175 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e431ae-18f5-4b62-8883-e1d6006ad20b None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.694662 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e431ae-18f5-4b62-8883-e1d6006ad20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.781359 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-08e431ae-18f5-4b62-8883-e1d6006ad20b None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:44.782985 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-08e431ae-18f5-4b62-8883-e1d6006ad20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:44.893654 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 566/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:06:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:06:45.056743 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094988ad-0edc-45bc-9bd9-3412852faad5 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.058618 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-094988ad-0edc-45bc-9bd9-3412852faad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:45.160213 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094988ad-0edc-45bc-9bd9-3412852faad5 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.165627 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc60e9d-aeb5-483e-a6e3-b49268ab0529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.166291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc60e9d-aeb5-483e-a6e3-b49268ab0529 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.166586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc60e9d-aeb5-483e-a6e3-b49268ab0529 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.166860 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc60e9d-aeb5-483e-a6e3-b49268ab0529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.176535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc60e9d-aeb5-483e-a6e3-b49268ab0529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.178320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc60e9d-aeb5-483e-a6e3-b49268ab0529 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.189606 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 564/1130] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:06:46.060988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a603c-327e-4eb8-91c8-d559ac4438f5 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.061818 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a603c-327e-4eb8-91c8-d559ac4438f5 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.061818 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a603c-327e-4eb8-91c8-d559ac4438f5 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.063175 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 567/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:06:46.069990 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159aead-63b8-4db6-b40a-714bacdc7f04 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.070547 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159aead-63b8-4db6-b40a-714bacdc7f04 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.070777 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159aead-63b8-4db6-b40a-714bacdc7f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.092007 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-8159aead-63b8-4db6-b40a-714bacdc7f04 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:46.093242 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-8159aead-63b8-4db6-b40a-714bacdc7f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:46.102445 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 565/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:06:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:06:46.273031 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a603c-327e-4eb8-91c8-d559ac4438f5 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:46.288236 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a603c-327e-4eb8-91c8-d559ac4438f5 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:46.293302 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3c2e3-8574-4077-af6e-dbdbf2d3445d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.293955 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3c2e3-8574-4077-af6e-dbdbf2d3445d service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.294248 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3c2e3-8574-4077-af6e-dbdbf2d3445d service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.294525 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3c2e3-8574-4077-af6e-dbdbf2d3445d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.304709 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3c2e3-8574-4077-af6e-dbdbf2d3445d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:46.306426 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3c2e3-8574-4077-af6e-dbdbf2d3445d service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:46.317735 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 568/1133] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:06:50.893298 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d48358-893e-4253-905a-522b7591ceb4 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.893854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d48358-893e-4253-905a-522b7591ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.893854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d48358-893e-4253-905a-522b7591ceb4 None None] PATH_INFO: `/v3` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.895176 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 566/1134] 10.222.0.100 () {54 vars in 926 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.901132 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810660f-605e-4ef5-945d-a64bc5538d62 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.901551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810660f-605e-4ef5-945d-a64bc5538d62 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.901693 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810660f-605e-4ef5-945d-a64bc5538d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.935676 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-6810660f-605e-4ef5-945d-a64bc5538d62 None None] MFA Rules not processed for user `679756d5f79e451bba682356d961883f`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:50.936889 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-6810660f-605e-4ef5-945d-a64bc5538d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:50.992218 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.001925 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 569/1135] 10.222.0.100 () {58 vars in 1016 bytes} [Mon Jul 25 19:06:50 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:06:55.182156 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f174d-4dd0-441a-a998-dc522cc1f1db None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.182156 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f174d-4dd0-441a-a998-dc522cc1f1db None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.184310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f174d-4dd0-441a-a998-dc522cc1f1db None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.184310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 567/1136] 10.222.0.98 () {54 vars in 961 bytes} [Mon Jul 25 19:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:06:55.189102 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fe2ba-2604-4f2f-ba29-5c218fab3b89 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.189620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fe2ba-2604-4f2f-ba29-5c218fab3b89 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.190259 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fe2ba-2604-4f2f-ba29-5c218fab3b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.211820 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-f92fe2ba-2604-4f2f-ba29-5c218fab3b89 None None] MFA Rules not processed for user `679756d5f79e451bba682356d961883f`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:55.213053 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-f92fe2ba-2604-4f2f-ba29-5c218fab3b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:55.222116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 570/1137] 10.222.0.98 () {58 vars in 1058 bytes} [Mon Jul 25 19:06:55 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:06:55.229874 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f174d-4dd0-441a-a998-dc522cc1f1db None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:55.244796 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f174d-4dd0-441a-a998-dc522cc1f1db None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.249807 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc9b0b-f8ce-4f12-9cad-e32573dc0ab5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679756d5f79e451bba682356d961883f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.250452 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9b0b-f8ce-4f12-9cad-e32573dc0ab5 service placement] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.250736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9b0b-f8ce-4f12-9cad-e32573dc0ab5 service placement] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.251011 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9b0b-f8ce-4f12-9cad-e32573dc0ab5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.260649 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc9b0b-f8ce-4f12-9cad-e32573dc0ab5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.262264 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc9b0b-f8ce-4f12-9cad-e32573dc0ab5 service placement] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.273823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 568/1138] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:06:57.615591 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e721cd3-76ca-4c1a-a347-4ea484c1f9f3 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:57.616582 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e721cd3-76ca-4c1a-a347-4ea484c1f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:57.616582 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e721cd3-76ca-4c1a-a347-4ea484c1f9f3 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.617793 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:06:57.622889 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e42dba-38af-4db8-9505-5aab4fc40bd1 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:57.623440 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e42dba-38af-4db8-9505-5aab4fc40bd1 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:57.623545 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e42dba-38af-4db8-9505-5aab4fc40bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.644733 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-a7e42dba-38af-4db8-9505-5aab4fc40bd1 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:57.646021 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-a7e42dba-38af-4db8-9505-5aab4fc40bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:57.654310 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:06:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:06:57.818670 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e721cd3-76ca-4c1a-a347-4ea484c1f9f3 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:57.833980 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e721cd3-76ca-4c1a-a347-4ea484c1f9f3 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:57.838926 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62166061-45ce-45bc-8e9e-f63d93bf1956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:57.839617 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62166061-45ce-45bc-8e9e-f63d93bf1956 service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:57.839904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62166061-45ce-45bc-8e9e-f63d93bf1956 service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:57.840178 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62166061-45ce-45bc-8e9e-f63d93bf1956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.849047 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62166061-45ce-45bc-8e9e-f63d93bf1956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:57.850673 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62166061-45ce-45bc-8e9e-f63d93bf1956 service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:57.860796 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 572/1141] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:06:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:06:58.721097 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84042b-72b5-4a94-93f9-fcef7936d6da None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.721691 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84042b-72b5-4a94-93f9-fcef7936d6da None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.721691 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84042b-72b5-4a94-93f9-fcef7936d6da None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.723153 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 570/1142] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:06:58.728224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725d2f4-5958-4567-9e1e-b4f11a9d9950 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.728705 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725d2f4-5958-4567-9e1e-b4f11a9d9950 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.728901 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725d2f4-5958-4567-9e1e-b4f11a9d9950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.749471 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-8725d2f4-5958-4567-9e1e-b4f11a9d9950 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:58.750721 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-8725d2f4-5958-4567-9e1e-b4f11a9d9950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:58.759530 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 573/1143] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:06:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:06:58.926510 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84042b-72b5-4a94-93f9-fcef7936d6da None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:58.941161 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84042b-72b5-4a94-93f9-fcef7936d6da None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:58.946604 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9f5ec-f293-49ae-8b58-998b78471f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:58.947223 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9f5ec-f293-49ae-8b58-998b78471f10 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.947510 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9f5ec-f293-49ae-8b58-998b78471f10 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.947812 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9f5ec-f293-49ae-8b58-998b78471f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.958240 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9f5ec-f293-49ae-8b58-998b78471f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:58.960092 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9f5ec-f293-49ae-8b58-998b78471f10 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:58.972053 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 571/1144] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:06:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:07:03.282713 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ee423-10aa-480f-beba-607eb7544475 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:03.283377 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ee423-10aa-480f-beba-607eb7544475 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:03.283377 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ee423-10aa-480f-beba-607eb7544475 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:03.284744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:07:03.290324 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6caee9-1a02-42c7-b815-a0eb8abfecfd None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:03.290771 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6caee9-1a02-42c7-b815-a0eb8abfecfd None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:03.291056 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6caee9-1a02-42c7-b815-a0eb8abfecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:03.311642 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-5a6caee9-1a02-42c7-b815-a0eb8abfecfd None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:03.312874 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-5a6caee9-1a02-42c7-b815-a0eb8abfecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:03.321306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:07:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:07:03.360124 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ee423-10aa-480f-beba-607eb7544475 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:03.362795 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-081ee423-10aa-480f-beba-607eb7544475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:03.424337 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ee423-10aa-480f-beba-607eb7544475 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:03.428141 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36fa03-7c7f-4cf2-a51d-df18bb4a746a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:03.428805 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36fa03-7c7f-4cf2-a51d-df18bb4a746a service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:03.429088 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36fa03-7c7f-4cf2-a51d-df18bb4a746a service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:03.429363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36fa03-7c7f-4cf2-a51d-df18bb4a746a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:03.440095 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36fa03-7c7f-4cf2-a51d-df18bb4a746a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:03.442019 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36fa03-7c7f-4cf2-a51d-df18bb4a746a service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:03.452228 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 575/1147] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:07:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:07:05.715998 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7730-fd9d-43c4-977a-39ad5589eaad None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.716607 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7730-fd9d-43c4-977a-39ad5589eaad None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.716607 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7730-fd9d-43c4-977a-39ad5589eaad None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.717918 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 573/1148] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:07:05.724038 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be5adf-2ec1-4d8e-a89f-a61d05e7fc0a None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.724651 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be5adf-2ec1-4d8e-a89f-a61d05e7fc0a None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.724651 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be5adf-2ec1-4d8e-a89f-a61d05e7fc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.745460 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-f0be5adf-2ec1-4d8e-a89f-a61d05e7fc0a None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:05.746804 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-f0be5adf-2ec1-4d8e-a89f-a61d05e7fc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:05.755202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 576/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:07:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:07:05.795218 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b7730-fd9d-43c4-977a-39ad5589eaad None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:05.806535 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b7730-fd9d-43c4-977a-39ad5589eaad None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:05.810320 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89b6c4-13c8-4636-bfcb-b04a205f354b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:05.810987 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89b6c4-13c8-4636-bfcb-b04a205f354b service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.811306 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89b6c4-13c8-4636-bfcb-b04a205f354b service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.811591 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89b6c4-13c8-4636-bfcb-b04a205f354b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.822313 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89b6c4-13c8-4636-bfcb-b04a205f354b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:05.823926 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89b6c4-13c8-4636-bfcb-b04a205f354b service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:05.835291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 574/1150] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:07:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:07:09.815652 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00973126-22f8-4079-ba00-7b76a347d53d None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:09.816221 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00973126-22f8-4079-ba00-7b76a347d53d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:09.816221 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00973126-22f8-4079-ba00-7b76a347d53d None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:09.817548 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 577/1151] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:07:09.822771 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e4b69-136a-4335-aa98-4d5aca182d7c None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:09.823272 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e4b69-136a-4335-aa98-4d5aca182d7c None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:09.823386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e4b69-136a-4335-aa98-4d5aca182d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:09.843316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-927e4b69-136a-4335-aa98-4d5aca182d7c None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:09.844522 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-927e4b69-136a-4335-aa98-4d5aca182d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:09.852284 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 575/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:07:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:07:10.137403 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00973126-22f8-4079-ba00-7b76a347d53d None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.139160 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-00973126-22f8-4079-ba00-7b76a347d53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:10.199173 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00973126-22f8-4079-ba00-7b76a347d53d None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.203324 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c6904-acdd-4fda-906c-4d8b6d2f2868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c000c774dc134acabf8abaa701de3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.203991 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c6904-acdd-4fda-906c-4d8b6d2f2868 service cinder] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.204310 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c6904-acdd-4fda-906c-4d8b6d2f2868 service cinder] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.206282 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c6904-acdd-4fda-906c-4d8b6d2f2868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.215839 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c6904-acdd-4fda-906c-4d8b6d2f2868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:10.217301 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c6904-acdd-4fda-906c-4d8b6d2f2868 service cinder] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:10.228188 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 578/1153] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:07:12.613462 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf3578-104b-47d8-b9c3-96745b2b07d5 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.613462 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf3578-104b-47d8-b9c3-96745b2b07d5 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.616278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf3578-104b-47d8-b9c3-96745b2b07d5 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.616278 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 576/1154] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:07:12.620851 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eae1cc-e0b5-40fb-a8ee-4532abc6504f None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.621303 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eae1cc-e0b5-40fb-a8ee-4532abc6504f None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.621467 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eae1cc-e0b5-40fb-a8ee-4532abc6504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.648409 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-e1eae1cc-e0b5-40fb-a8ee-4532abc6504f None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:12.649672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-e1eae1cc-e0b5-40fb-a8ee-4532abc6504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:12.658971 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 579/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:07:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:07:12.941814 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf3578-104b-47d8-b9c3-96745b2b07d5 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:12.943520 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-d0bf3578-104b-47d8-b9c3-96745b2b07d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:12.951241 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=70 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:12.958215 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf3578-104b-47d8-b9c3-96745b2b07d5 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:12.961685 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed3e1a-3e51-4cfc-a135-8442078d57f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c000c774dc134acabf8abaa701de3be4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:12.962316 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed3e1a-3e51-4cfc-a135-8442078d57f3 service cinder] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.962596 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed3e1a-3e51-4cfc-a135-8442078d57f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.962867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed3e1a-3e51-4cfc-a135-8442078d57f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.972148 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed3e1a-3e51-4cfc-a135-8442078d57f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:12.973572 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed3e1a-3e51-4cfc-a135-8442078d57f3 service cinder] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:12.982915 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 577/1156] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:07:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:07:22.641358 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=70 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:22.978812 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=5 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:36.160828 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58869db8-0a17-4790-8a45-0b81c1687b14 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.161450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58869db8-0a17-4790-8a45-0b81c1687b14 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.161450 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58869db8-0a17-4790-8a45-0b81c1687b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.181872 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-58869db8-0a17-4790-8a45-0b81c1687b14 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:36.183191 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-58869db8-0a17-4790-8a45-0b81c1687b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:36.191891 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 580/1157] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:08:36.194688 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89023cd4-9bdd-43b0-b1ca-4ece2656a292 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.195222 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89023cd4-9bdd-43b0-b1ca-4ece2656a292 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.195394 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89023cd4-9bdd-43b0-b1ca-4ece2656a292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.199889 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddc1a7-38e2-4cc5-bfa2-8c6da5a2c739 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.200225 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddc1a7-38e2-4cc5-bfa2-8c6da5a2c739 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.200545 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddc1a7-38e2-4cc5-bfa2-8c6da5a2c739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.218188 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-89023cd4-9bdd-43b0-b1ca-4ece2656a292 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:36.219604 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-89023cd4-9bdd-43b0-b1ca-4ece2656a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:36.222116 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-44ddc1a7-38e2-4cc5-bfa2-8c6da5a2c739 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:36.223370 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-44ddc1a7-38e2-4cc5-bfa2-8c6da5a2c739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:36.227700 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 578/1158] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:08:36.231276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 581/1159] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:08:36.235975 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89023cd4-9bdd-43b0-b1ca-4ece2656a292 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.236534 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fa8e9-8f6c-4a63-a104-b0c9171a1782 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.236865 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fa8e9-8f6c-4a63-a104-b0c9171a1782 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.237181 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fa8e9-8f6c-4a63-a104-b0c9171a1782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.246040 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89023cd4-9bdd-43b0-b1ca-4ece2656a292 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.251958 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13489b46-309b-4a8f-8fe7-a0e7ba189595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.252623 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13489b46-309b-4a8f-8fe7-a0e7ba189595 admin admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.252909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13489b46-309b-4a8f-8fe7-a0e7ba189595 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.253190 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13489b46-309b-4a8f-8fe7-a0e7ba189595 admin admin] PATH_INFO: `/v3/domains` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.253927 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13489b46-309b-4a8f-8fe7-a0e7ba189595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:36.254236 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13489b46-309b-4a8f-8fe7-a0e7ba189595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.255318 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: WARNING py.warnings [None req-13489b46-309b-4a8f-8fe7-a0e7ba189595 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:08:36.255318 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: warnings.warn(msg) Jul 25 19:08:36.255318 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: Jul 25 19:08:36.256206 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13489b46-309b-4a8f-8fe7-a0e7ba189595 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.257587 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-421fa8e9-8f6c-4a63-a104-b0c9171a1782 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:36.258832 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-421fa8e9-8f6c-4a63-a104-b0c9171a1782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:36.267509 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 582/1160] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:08:36.276022 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 579/1161] 10.222.0.98 () {58 vars in 1153 bytes} [Mon Jul 25 19:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:36.276187 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fa8e9-8f6c-4a63-a104-b0c9171a1782 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.277440 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13489b46-309b-4a8f-8fe7-a0e7ba189595 admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.282126 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fa8e9-8f6c-4a63-a104-b0c9171a1782 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.286802 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10c64b-e244-430e-bb3d-d0f1fe92fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.287512 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10c64b-e244-430e-bb3d-d0f1fe92fe13 admin admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.287837 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10c64b-e244-430e-bb3d-d0f1fe92fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.288082 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13489b46-309b-4a8f-8fe7-a0e7ba189595 admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.288197 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10c64b-e244-430e-bb3d-d0f1fe92fe13 admin admin] PATH_INFO: `/v3/domains` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.288900 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10c64b-e244-430e-bb3d-d0f1fe92fe13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:36.289245 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10c64b-e244-430e-bb3d-d0f1fe92fe13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.290892 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10c64b-e244-430e-bb3d-d0f1fe92fe13 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.292670 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00bc29-adbe-4e08-b1d4-0414ef0a2342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.293321 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00bc29-adbe-4e08-b1d4-0414ef0a2342 admin admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.293607 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00bc29-adbe-4e08-b1d4-0414ef0a2342 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.293883 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00bc29-adbe-4e08-b1d4-0414ef0a2342 admin admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.294571 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00bc29-adbe-4e08-b1d4-0414ef0a2342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.297193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00bc29-adbe-4e08-b1d4-0414ef0a2342 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.304137 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 583/1162] 10.222.0.98 () {58 vars in 1153 bytes} [Mon Jul 25 19:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:36.312677 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10c64b-e244-430e-bb3d-d0f1fe92fe13 admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.322319 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10c64b-e244-430e-bb3d-d0f1fe92fe13 admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.329384 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99249ab-1679-449d-b4e1-1f34b28b8e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.330064 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99249ab-1679-449d-b4e1-1f34b28b8e46 admin admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.330354 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99249ab-1679-449d-b4e1-1f34b28b8e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.330630 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99249ab-1679-449d-b4e1-1f34b28b8e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.331350 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99249ab-1679-449d-b4e1-1f34b28b8e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.332375 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: WARNING py.warnings [None req-c99249ab-1679-449d-b4e1-1f34b28b8e46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:08:36.332375 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: warnings.warn(msg) Jul 25 19:08:36.332375 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: Jul 25 19:08:36.333569 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99249ab-1679-449d-b4e1-1f34b28b8e46 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.335880 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 580/1163] 10.222.0.98 () {60 vars in 1153 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:08:36.339771 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00bc29-adbe-4e08-b1d4-0414ef0a2342 admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.364058 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 584/1164] 10.222.0.98 () {60 vars in 1153 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:08:36.368081 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99249ab-1679-449d-b4e1-1f34b28b8e46 admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.403849 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00bc29-adbe-4e08-b1d4-0414ef0a2342 admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.433069 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99249ab-1679-449d-b4e1-1f34b28b8e46 admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.437767 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d9ef-3931-46ba-a4c1-2c48df1b8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.438434 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d9ef-3931-46ba-a4c1-2c48df1b8575 admin admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.438719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d9ef-3931-46ba-a4c1-2c48df1b8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.438994 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d9ef-3931-46ba-a4c1-2c48df1b8575 admin admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.439716 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70d9ef-3931-46ba-a4c1-2c48df1b8575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.441675 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70d9ef-3931-46ba-a4c1-2c48df1b8575 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.462283 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927d70-a451-4795-ae06-2a124c3f306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.462969 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927d70-a451-4795-ae06-2a124c3f306f admin admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.463296 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927d70-a451-4795-ae06-2a124c3f306f admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.463576 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927d70-a451-4795-ae06-2a124c3f306f admin admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.464270 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22927d70-a451-4795-ae06-2a124c3f306f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.465287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: WARNING py.warnings [None req-22927d70-a451-4795-ae06-2a124c3f306f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:08:36.465287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: warnings.warn(msg) Jul 25 19:08:36.465287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: Jul 25 19:08:36.465744 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 585/1165] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:08:36.468156 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22927d70-a451-4795-ae06-2a124c3f306f admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.470006 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d9ef-3931-46ba-a4c1-2c48df1b8575 admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.479896 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d9ef-3931-46ba-a4c1-2c48df1b8575 admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.486201 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc91d-28a2-4ca7-9a85-12f68b873c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.486888 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc91d-28a2-4ca7-9a85-12f68b873c0b admin admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.487209 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc91d-28a2-4ca7-9a85-12f68b873c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.487492 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc91d-28a2-4ca7-9a85-12f68b873c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.488220 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dc91d-28a2-4ca7-9a85-12f68b873c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.490120 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dc91d-28a2-4ca7-9a85-12f68b873c0b admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.492125 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 581/1166] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:08:36.496227 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927d70-a451-4795-ae06-2a124c3f306f admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.500609 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 586/1167] 10.222.0.98 () {58 vars in 1122 bytes} [Mon Jul 25 19:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:08:36.504460 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc91d-28a2-4ca7-9a85-12f68b873c0b admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.506592 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927d70-a451-4795-ae06-2a124c3f306f admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.511323 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158895f-a216-49eb-b5da-217a9ba02e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.511989 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158895f-a216-49eb-b5da-217a9ba02e82 admin admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.512274 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158895f-a216-49eb-b5da-217a9ba02e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.512553 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158895f-a216-49eb-b5da-217a9ba02e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.513274 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158895f-a216-49eb-b5da-217a9ba02e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.514499 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc91d-28a2-4ca7-9a85-12f68b873c0b admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.515440 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158895f-a216-49eb-b5da-217a9ba02e82 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.519315 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240e1aa-7588-4a26-a210-b34a2390f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.519970 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240e1aa-7588-4a26-a210-b34a2390f4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.520255 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240e1aa-7588-4a26-a210-b34a2390f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.520533 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240e1aa-7588-4a26-a210-b34a2390f4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.521251 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240e1aa-7588-4a26-a210-b34a2390f4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.522844 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240e1aa-7588-4a26-a210-b34a2390f4f2 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.528481 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 582/1168] 10.222.0.98 () {58 vars in 1122 bytes} [Mon Jul 25 19:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:08:36.530057 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158895f-a216-49eb-b5da-217a9ba02e82 admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.534355 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 587/1169] 10.222.0.98 () {58 vars in 1122 bytes} [Mon Jul 25 19:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:08:36.538461 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240e1aa-7588-4a26-a210-b34a2390f4f2 admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.540289 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158895f-a216-49eb-b5da-217a9ba02e82 admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.544946 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701678c-6f97-4d7b-b4fd-23ad4a2c10ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.546154 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701678c-6f97-4d7b-b4fd-23ad4a2c10ef admin admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.546541 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701678c-6f97-4d7b-b4fd-23ad4a2c10ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.546823 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701678c-6f97-4d7b-b4fd-23ad4a2c10ef admin admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.547586 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701678c-6f97-4d7b-b4fd-23ad4a2c10ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.549183 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701678c-6f97-4d7b-b4fd-23ad4a2c10ef admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.549387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240e1aa-7588-4a26-a210-b34a2390f4f2 admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.554259 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced61a2-0675-4a59-8be1-f53d059a6892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.555664 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced61a2-0675-4a59-8be1-f53d059a6892 admin admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.555954 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced61a2-0675-4a59-8be1-f53d059a6892 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.556232 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced61a2-0675-4a59-8be1-f53d059a6892 admin admin] PATH_INFO: `/v3/projects/f970202f866640ef959780976de9f3f8/users/16dfb749c2af4b67964f1a19038eee5e/roles/7bea6298af7e4980950949b024a1e103` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.560058 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 583/1170] 10.222.0.98 () {58 vars in 1122 bytes} [Mon Jul 25 19:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:08:36.564774 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701678c-6f97-4d7b-b4fd-23ad4a2c10ef admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.572620 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced61a2-0675-4a59-8be1-f53d059a6892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f970202f866640ef959780976de9f3f8, user_id=16dfb749c2af4b67964f1a19038eee5e, role_id=7bea6298af7e4980950949b024a1e103)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.573865 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: WARNING py.warnings [None req-3ced61a2-0675-4a59-8be1-f53d059a6892 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:08:36.573865 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: warnings.warn(msg) Jul 25 19:08:36.573865 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: Jul 25 19:08:36.574952 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701678c-6f97-4d7b-b4fd-23ad4a2c10ef admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.575701 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced61a2-0675-4a59-8be1-f53d059a6892 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.586411 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2e77e-e9d8-464b-a5a1-ab9d8e63d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.587527 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2e77e-e9d8-464b-a5a1-ab9d8e63d616 admin admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.587818 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2e77e-e9d8-464b-a5a1-ab9d8e63d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.588096 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2e77e-e9d8-464b-a5a1-ab9d8e63d616 admin admin] PATH_INFO: `/v3/projects/f3e531ef7faa48ab9f512516351a7eb4/users/7104acbe372c477b853d928c3965bdea/roles/7bea6298af7e4980950949b024a1e103` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.590453 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 588/1171] 10.222.0.98 () {60 vars in 1483 bytes} [Mon Jul 25 19:08:36 2022] PUT /identity/v3/projects/f970202f866640ef959780976de9f3f8/users/16dfb749c2af4b67964f1a19038eee5e/roles/7bea6298af7e4980950949b024a1e103 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:08:36.595533 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa87b7-628a-415d-9491-28db19590f88 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.595829 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa87b7-628a-415d-9491-28db19590f88 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.596126 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa87b7-628a-415d-9491-28db19590f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.605979 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2e77e-e9d8-464b-a5a1-ab9d8e63d616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e531ef7faa48ab9f512516351a7eb4, user_id=7104acbe372c477b853d928c3965bdea, role_id=7bea6298af7e4980950949b024a1e103)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.609281 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2e77e-e9d8-464b-a5a1-ab9d8e63d616 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.616390 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-bcaa87b7-628a-415d-9491-28db19590f88 None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:36.617629 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-bcaa87b7-628a-415d-9491-28db19590f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:36.618904 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:36.625286 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 584/1172] 10.222.0.98 () {60 vars in 1483 bytes} [Mon Jul 25 19:08:36 2022] PUT /identity/v3/projects/f3e531ef7faa48ab9f512516351a7eb4/users/7104acbe372c477b853d928c3965bdea/roles/7bea6298af7e4980950949b024a1e103 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:08:36.636192 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de211221-fb89-49ad-ac4a-3757f1d383df None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.636854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de211221-fb89-49ad-ac4a-3757f1d383df None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.637447 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de211221-fb89-49ad-ac4a-3757f1d383df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.657296 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-de211221-fb89-49ad-ac4a-3757f1d383df None None] MFA Rules not processed for user `4a14840580b5465f8931c6040356529d`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:36.658188 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-de211221-fb89-49ad-ac4a-3757f1d383df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:36.663654 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:36.684874 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 589/1173] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:08:36.697706 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa87b7-628a-415d-9491-28db19590f88 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.720531 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 585/1174] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:08:36.730636 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de211221-fb89-49ad-ac4a-3757f1d383df None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.754171 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa87b7-628a-415d-9491-28db19590f88 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.757871 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b253b-d358-440f-adb5-6e7d0a35df9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.758520 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b253b-d358-440f-adb5-6e7d0a35df9a service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.758812 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b253b-d358-440f-adb5-6e7d0a35df9a service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.759094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b253b-d358-440f-adb5-6e7d0a35df9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.769111 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b253b-d358-440f-adb5-6e7d0a35df9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.770575 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b253b-d358-440f-adb5-6e7d0a35df9a service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.781218 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 590/1175] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:08:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:08:36.788373 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de211221-fb89-49ad-ac4a-3757f1d383df None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.792135 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a3123-5308-4e40-9373-fb93892e0297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.792820 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a3123-5308-4e40-9373-fb93892e0297 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.793110 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a3123-5308-4e40-9373-fb93892e0297 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.793395 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a3123-5308-4e40-9373-fb93892e0297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.804429 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a3123-5308-4e40-9373-fb93892e0297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.806292 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a3123-5308-4e40-9373-fb93892e0297 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.816904 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 586/1176] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:08:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:08:42.749968 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b255e-4e46-4a81-bac2-77e32ed0dae9 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:42.750959 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b255e-4e46-4a81-bac2-77e32ed0dae9 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:42.751509 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b255e-4e46-4a81-bac2-77e32ed0dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:42.793387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-e49b255e-4e46-4a81-bac2-77e32ed0dae9 None None] MFA Rules not processed for user `7104acbe372c477b853d928c3965bdea`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:42.794908 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-e49b255e-4e46-4a81-bac2-77e32ed0dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:42.926995 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 591/1177] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:08:42 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:08:42.933792 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a3123-5308-4e40-9373-fb93892e0297 service neutron] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:42.978034 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a3123-5308-4e40-9373-fb93892e0297 service neutron] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:42.987893 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a13e2-2cf4-4c16-8b39-634f959cac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:42.990600 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a13e2-2cf4-4c16-8b39-634f959cac8c admin admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:42.991004 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a13e2-2cf4-4c16-8b39-634f959cac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:42.991419 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a13e2-2cf4-4c16-8b39-634f959cac8c admin admin] PATH_INFO: `/v3/projects` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:42.992375 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a13e2-2cf4-4c16-8b39-634f959cac8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:42.996177 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a13e2-2cf4-4c16-8b39-634f959cac8c admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:43.038730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 587/1178] 10.222.0.98 () {60 vars in 1153 bytes} [Mon Jul 25 19:08:42 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:08:43.045931 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b255e-4e46-4a81-bac2-77e32ed0dae9 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:43.070473 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b255e-4e46-4a81-bac2-77e32ed0dae9 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:43.166996 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c70f6c-e639-4638-95fa-9f683b96cd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:43.168767 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c70f6c-e639-4638-95fa-9f683b96cd34 admin admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:43.169117 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c70f6c-e639-4638-95fa-9f683b96cd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:43.169460 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c70f6c-e639-4638-95fa-9f683b96cd34 admin admin] PATH_INFO: `/v3/users` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:43.171564 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c70f6c-e639-4638-95fa-9f683b96cd34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:43.173651 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c70f6c-e639-4638-95fa-9f683b96cd34 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:43.202904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 592/1179] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 19:08:43 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:08:43.204192 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a13e2-2cf4-4c16-8b39-634f959cac8c admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:43.215084 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a13e2-2cf4-4c16-8b39-634f959cac8c admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:43.224806 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab82a-0a25-4e5b-b37c-85cbc5ffe254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:43.225050 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab82a-0a25-4e5b-b37c-85cbc5ffe254 admin admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:43.225261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab82a-0a25-4e5b-b37c-85cbc5ffe254 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:43.225556 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab82a-0a25-4e5b-b37c-85cbc5ffe254 admin admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:43.226291 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab82a-0a25-4e5b-b37c-85cbc5ffe254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:43.229043 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab82a-0a25-4e5b-b37c-85cbc5ffe254 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:43.246039 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 588/1180] 10.222.0.98 () {58 vars in 1122 bytes} [Mon Jul 25 19:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:08:43.247193 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c70f6c-e639-4638-95fa-9f683b96cd34 admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:43.260985 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c70f6c-e639-4638-95fa-9f683b96cd34 admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:43.266624 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879f24-0b09-4d5c-a29d-c1418f1208b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:43.267776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879f24-0b09-4d5c-a29d-c1418f1208b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:43.267922 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879f24-0b09-4d5c-a29d-c1418f1208b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:43.268270 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879f24-0b09-4d5c-a29d-c1418f1208b2 admin admin] PATH_INFO: `/v3/projects/7df985c4fc8d40e19f6b7d2bfb7a4c2f/users/8ee9f7487594444eb7ea3372f3c4dd84/roles/472a286d91bd484a83e2de07fc231c06` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:43.280527 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:43.294027 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b879f24-0b09-4d5c-a29d-c1418f1208b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df985c4fc8d40e19f6b7d2bfb7a4c2f, user_id=8ee9f7487594444eb7ea3372f3c4dd84, role_id=472a286d91bd484a83e2de07fc231c06)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:43.305087 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b879f24-0b09-4d5c-a29d-c1418f1208b2 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:43.323461 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 593/1181] 10.222.0.98 () {60 vars in 1483 bytes} [Mon Jul 25 19:08:43 2022] PUT /identity/v3/projects/7df985c4fc8d40e19f6b7d2bfb7a4c2f/users/8ee9f7487594444eb7ea3372f3c4dd84/roles/472a286d91bd484a83e2de07fc231c06 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:08:43.327695 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab82a-0a25-4e5b-b37c-85cbc5ffe254 admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:43.340790 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab82a-0a25-4e5b-b37c-85cbc5ffe254 admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:43.465867 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f213b8-9536-4fdc-b8b2-ce6b69ecf9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:43.467733 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f213b8-9536-4fdc-b8b2-ce6b69ecf9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:43.468076 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f213b8-9536-4fdc-b8b2-ce6b69ecf9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:43.468362 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f213b8-9536-4fdc-b8b2-ce6b69ecf9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:43.469318 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f213b8-9536-4fdc-b8b2-ce6b69ecf9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:43.470782 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f213b8-9536-4fdc-b8b2-ce6b69ecf9d5 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:43.483529 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 589/1182] 10.222.0.98 () {58 vars in 1122 bytes} [Mon Jul 25 19:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:08:43.488659 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879f24-0b09-4d5c-a29d-c1418f1208b2 admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:43.505414 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879f24-0b09-4d5c-a29d-c1418f1208b2 admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:43.510807 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef59e-fd93-4960-8a8b-ae07f23ea60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:43.511772 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef59e-fd93-4960-8a8b-ae07f23ea60b admin admin] REQUEST_METHOD: `PUT` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:43.512056 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef59e-fd93-4960-8a8b-ae07f23ea60b admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:43.512329 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef59e-fd93-4960-8a8b-ae07f23ea60b admin admin] PATH_INFO: `/v3/projects/7df985c4fc8d40e19f6b7d2bfb7a4c2f/users/8ee9f7487594444eb7ea3372f3c4dd84/roles/472a286d91bd484a83e2de07fc231c06` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:43.515377 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eef59e-fd93-4960-8a8b-ae07f23ea60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df985c4fc8d40e19f6b7d2bfb7a4c2f, user_id=8ee9f7487594444eb7ea3372f3c4dd84, role_id=472a286d91bd484a83e2de07fc231c06)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:43.518469 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eef59e-fd93-4960-8a8b-ae07f23ea60b admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:43.539002 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 594/1183] 10.222.0.98 () {60 vars in 1483 bytes} [Mon Jul 25 19:08:43 2022] PUT /identity/v3/projects/7df985c4fc8d40e19f6b7d2bfb7a4c2f/users/8ee9f7487594444eb7ea3372f3c4dd84/roles/472a286d91bd484a83e2de07fc231c06 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:08:43.999630 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dd7ef-7c84-4f61-9399-1784d451e06d None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.000287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dd7ef-7c84-4f61-9399-1784d451e06d None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.000387 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dd7ef-7c84-4f61-9399-1784d451e06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.022058 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:44.052093 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-3b8dd7ef-7c84-4f61-9399-1784d451e06d None None] MFA Rules not processed for user `16dfb749c2af4b67964f1a19038eee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:44.053628 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-3b8dd7ef-7c84-4f61-9399-1784d451e06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:44.132708 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 590/1184] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:08:43 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:08:44.137573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef59e-fd93-4960-8a8b-ae07f23ea60b admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.222302 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef59e-fd93-4960-8a8b-ae07f23ea60b admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.228659 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefc5da-0b7f-41f8-aaf9-ac271ef1d7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.231415 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefc5da-0b7f-41f8-aaf9-ac271ef1d7da admin admin] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.231883 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefc5da-0b7f-41f8-aaf9-ac271ef1d7da admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.232938 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefc5da-0b7f-41f8-aaf9-ac271ef1d7da admin admin] PATH_INFO: `/v3/projects` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.234387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefc5da-0b7f-41f8-aaf9-ac271ef1d7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:44.236854 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefc5da-0b7f-41f8-aaf9-ac271ef1d7da admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:44.270400 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 595/1185] 10.222.0.98 () {60 vars in 1153 bytes} [Mon Jul 25 19:08:44 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:08:44.274369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dd7ef-7c84-4f61-9399-1784d451e06d None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.288036 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dd7ef-7c84-4f61-9399-1784d451e06d None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.405277 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e200c-33a4-440a-a762-05857b83cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.406714 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e200c-33a4-440a-a762-05857b83cfa8 admin admin] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.407232 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e200c-33a4-440a-a762-05857b83cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.407729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e200c-33a4-440a-a762-05857b83cfa8 admin admin] PATH_INFO: `/v3/users` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.408568 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e200c-33a4-440a-a762-05857b83cfa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:44.411854 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e200c-33a4-440a-a762-05857b83cfa8 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:44.438248 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 591/1186] 10.222.0.98 () {60 vars in 1144 bytes} [Mon Jul 25 19:08:44 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:08:44.442132 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefc5da-0b7f-41f8-aaf9-ac271ef1d7da admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.454396 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefc5da-0b7f-41f8-aaf9-ac271ef1d7da admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.459378 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6221-6d67-4e5c-b4ba-e05fad38af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.460063 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6221-6d67-4e5c-b4ba-e05fad38af6f admin admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.460354 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6221-6d67-4e5c-b4ba-e05fad38af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.460825 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6221-6d67-4e5c-b4ba-e05fad38af6f admin admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.462657 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a6221-6d67-4e5c-b4ba-e05fad38af6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:44.464485 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a6221-6d67-4e5c-b4ba-e05fad38af6f admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:44.479022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 596/1187] 10.222.0.98 () {58 vars in 1122 bytes} [Mon Jul 25 19:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:08:44.484718 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e200c-33a4-440a-a762-05857b83cfa8 admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.498595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e200c-33a4-440a-a762-05857b83cfa8 admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.504819 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57dfb0-e4b2-4d1b-8a53-3054420aa25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.505884 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57dfb0-e4b2-4d1b-8a53-3054420aa25f admin admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.506294 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57dfb0-e4b2-4d1b-8a53-3054420aa25f admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.506614 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57dfb0-e4b2-4d1b-8a53-3054420aa25f admin admin] PATH_INFO: `/v3/projects/55066eb5e299418da7a8d550a314f8d8/users/3f8e4fdffeb5425e9fc88acbf543b773/roles/472a286d91bd484a83e2de07fc231c06` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.523639 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57dfb0-e4b2-4d1b-8a53-3054420aa25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55066eb5e299418da7a8d550a314f8d8, user_id=3f8e4fdffeb5425e9fc88acbf543b773, role_id=472a286d91bd484a83e2de07fc231c06)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:44.526484 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57dfb0-e4b2-4d1b-8a53-3054420aa25f admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:44.554708 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 592/1188] 10.222.0.98 () {60 vars in 1483 bytes} [Mon Jul 25 19:08:44 2022] PUT /identity/v3/projects/55066eb5e299418da7a8d550a314f8d8/users/3f8e4fdffeb5425e9fc88acbf543b773/roles/472a286d91bd484a83e2de07fc231c06 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:08:44.556896 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6221-6d67-4e5c-b4ba-e05fad38af6f admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.567276 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6221-6d67-4e5c-b4ba-e05fad38af6f admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.670202 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa46c1-8eb3-4988-aadd-3b1124913976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.670890 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa46c1-8eb3-4988-aadd-3b1124913976 admin admin] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.672122 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa46c1-8eb3-4988-aadd-3b1124913976 admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.672270 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa46c1-8eb3-4988-aadd-3b1124913976 admin admin] PATH_INFO: `/v3/roles` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.672896 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa46c1-8eb3-4988-aadd-3b1124913976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:44.674559 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa46c1-8eb3-4988-aadd-3b1124913976 admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:44.689692 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 597/1189] 10.222.0.98 () {58 vars in 1122 bytes} [Mon Jul 25 19:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:08:44.694656 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57dfb0-e4b2-4d1b-8a53-3054420aa25f admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.706846 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57dfb0-e4b2-4d1b-8a53-3054420aa25f admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.712241 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d81c-523e-4b76-860c-61af8e7fcc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.713146 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d81c-523e-4b76-860c-61af8e7fcc2b admin admin] REQUEST_METHOD: `PUT` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.713577 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d81c-523e-4b76-860c-61af8e7fcc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.713865 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d81c-523e-4b76-860c-61af8e7fcc2b admin admin] PATH_INFO: `/v3/projects/55066eb5e299418da7a8d550a314f8d8/users/3f8e4fdffeb5425e9fc88acbf543b773/roles/472a286d91bd484a83e2de07fc231c06` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.716066 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447d81c-523e-4b76-860c-61af8e7fcc2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55066eb5e299418da7a8d550a314f8d8, user_id=3f8e4fdffeb5425e9fc88acbf543b773, role_id=472a286d91bd484a83e2de07fc231c06)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:44.719511 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447d81c-523e-4b76-860c-61af8e7fcc2b admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:44.734614 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 593/1190] 10.222.0.98 () {60 vars in 1483 bytes} [Mon Jul 25 19:08:44 2022] PUT /identity/v3/projects/55066eb5e299418da7a8d550a314f8d8/users/3f8e4fdffeb5425e9fc88acbf543b773/roles/472a286d91bd484a83e2de07fc231c06 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:08:50.342704 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92058a57-0d99-4f9a-a2dc-d96af1e46211 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:50.344091 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92058a57-0d99-4f9a-a2dc-d96af1e46211 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:50.344843 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92058a57-0d99-4f9a-a2dc-d96af1e46211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:50.408971 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-92058a57-0d99-4f9a-a2dc-d96af1e46211 None None] MFA Rules not processed for user `8ee9f7487594444eb7ea3372f3c4dd84`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:50.410460 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-92058a57-0d99-4f9a-a2dc-d96af1e46211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:50.481068 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:50.616205 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 598/1191] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:08:50 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:08:50.631590 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d81c-523e-4b76-860c-61af8e7fcc2b admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:50.633744 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-7447d81c-523e-4b76-860c-61af8e7fcc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:50.767244 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:50.826795 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d81c-523e-4b76-860c-61af8e7fcc2b admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:50.842971 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b3be9-c498-4eb1-ad5f-156b126bb0f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e21b5991e7345149a4d0e644a436099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:50.845980 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b3be9-c498-4eb1-ad5f-156b126bb0f8 service glance] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:50.846627 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b3be9-c498-4eb1-ad5f-156b126bb0f8 service glance] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:50.847198 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b3be9-c498-4eb1-ad5f-156b126bb0f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:51.088636 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b3be9-c498-4eb1-ad5f-156b126bb0f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:51.090046 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b3be9-c498-4eb1-ad5f-156b126bb0f8 service glance] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:51.109771 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 594/1192] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:08:50 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:08:51.769387 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc0358-c19d-4db0-8e8a-b7168587994e None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:51.769984 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc0358-c19d-4db0-8e8a-b7168587994e None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:51.769984 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc0358-c19d-4db0-8e8a-b7168587994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:51.835520 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-24bc0358-c19d-4db0-8e8a-b7168587994e None None] MFA Rules not processed for user `3f8e4fdffeb5425e9fc88acbf543b773`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:51.836785 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-24bc0358-c19d-4db0-8e8a-b7168587994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:51.973668 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 599/1193] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:08:51 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:08:51.985303 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b3be9-c498-4eb1-ad5f-156b126bb0f8 service glance] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:52.007824 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b3be9-c498-4eb1-ad5f-156b126bb0f8 service glance] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:52.018180 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72310a4e-cba4-49aa-8092-a753f1f36868 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e21b5991e7345149a4d0e644a436099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:52.019061 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72310a4e-cba4-49aa-8092-a753f1f36868 service glance] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:52.019398 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72310a4e-cba4-49aa-8092-a753f1f36868 service glance] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:52.020359 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72310a4e-cba4-49aa-8092-a753f1f36868 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:52.116605 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72310a4e-cba4-49aa-8092-a753f1f36868 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:52.118331 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72310a4e-cba4-49aa-8092-a753f1f36868 service glance] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:52.150463 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 595/1194] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:08:51 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:09:00.252143 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e095854-7237-48a6-b6e1-e1e6cd606580 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:00.252954 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e095854-7237-48a6-b6e1-e1e6cd606580 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:00.252954 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e095854-7237-48a6-b6e1-e1e6cd606580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:00.275035 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-1e095854-7237-48a6-b6e1-e1e6cd606580 None None] MFA Rules not processed for user `7104acbe372c477b853d928c3965bdea`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:00.276306 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-1e095854-7237-48a6-b6e1-e1e6cd606580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:00.284984 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 600/1195] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:09:00 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:09:00.603584 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab4f9-41cb-408d-8a92-2d18377ac9d9 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:00.604193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab4f9-41cb-408d-8a92-2d18377ac9d9 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:00.604193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab4f9-41cb-408d-8a92-2d18377ac9d9 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:00.607687 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 596/1196] 10.222.0.98 () {54 vars in 962 bytes} [Mon Jul 25 19:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:09:00.612227 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d403-8052-424b-9ebd-a530b8cf8cca None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:00.612615 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d403-8052-424b-9ebd-a530b8cf8cca None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:00.612900 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d403-8052-424b-9ebd-a530b8cf8cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:00.647672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-ed96d403-8052-424b-9ebd-a530b8cf8cca None None] MFA Rules not processed for user `6aa237d6badd493a9f2a75bf4086fec3`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:00.649107 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-ed96d403-8052-424b-9ebd-a530b8cf8cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:00.729094 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 601/1197] 10.222.0.98 () {58 vars in 1059 bytes} [Mon Jul 25 19:09:00 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:09:00.736001 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e1cb6-928a-4dfa-83d6-1ba14dd1e2f6 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:00.736419 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e1cb6-928a-4dfa-83d6-1ba14dd1e2f6 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:00.736800 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e1cb6-928a-4dfa-83d6-1ba14dd1e2f6 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:00.738528 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 597/1198] 10.222.0.98 () {54 vars in 912 bytes} [Mon Jul 25 19:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:09:00.744495 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657caa8a-ddab-4bdd-9ec8-796852a4c07a None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:00.745022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657caa8a-ddab-4bdd-9ec8-796852a4c07a None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:00.745352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657caa8a-ddab-4bdd-9ec8-796852a4c07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:00.770855 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-657caa8a-ddab-4bdd-9ec8-796852a4c07a None None] MFA Rules not processed for user `6aa237d6badd493a9f2a75bf4086fec3`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:00.772119 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-657caa8a-ddab-4bdd-9ec8-796852a4c07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:00.781453 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 602/1199] 10.222.0.98 () {58 vars in 1009 bytes} [Mon Jul 25 19:09:00 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:09:00.793153 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e1cb6-928a-4dfa-83d6-1ba14dd1e2f6 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:00.795679 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-b93e1cb6-928a-4dfa-83d6-1ba14dd1e2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:00.809336 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e1cb6-928a-4dfa-83d6-1ba14dd1e2f6 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:00.814034 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b862392-45b6-43b2-abf9-a40df740d200 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e21b5991e7345149a4d0e644a436099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:00.814770 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b862392-45b6-43b2-abf9-a40df740d200 service glance] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:00.815369 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b862392-45b6-43b2-abf9-a40df740d200 service glance] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:00.815761 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b862392-45b6-43b2-abf9-a40df740d200 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:00.827229 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b862392-45b6-43b2-abf9-a40df740d200 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:00.828682 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b862392-45b6-43b2-abf9-a40df740d200 service glance] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:00.839439 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 598/1200] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:09:00 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:09:01.206370 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0f4b-3ef0-480a-b004-94d2630bc73d None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:01.206663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0f4b-3ef0-480a-b004-94d2630bc73d None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:01.206946 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0f4b-3ef0-480a-b004-94d2630bc73d None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:01.208368 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 603/1201] 10.222.0.98 () {54 vars in 912 bytes} [Mon Jul 25 19:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:09:01.213616 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a5f7-4fb4-437e-934e-215e4931a878 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:01.213984 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a5f7-4fb4-437e-934e-215e4931a878 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:01.214295 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a5f7-4fb4-437e-934e-215e4931a878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:01.251794 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-7e48a5f7-4fb4-437e-934e-215e4931a878 None None] MFA Rules not processed for user `b04784c6c0684d8082b954cd4caf32bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:01.253396 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-7e48a5f7-4fb4-437e-934e-215e4931a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:01.320210 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 599/1202] 10.222.0.98 () {58 vars in 1009 bytes} [Mon Jul 25 19:09:01 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:09:01.333071 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a0f4b-3ef0-480a-b004-94d2630bc73d None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:01.344581 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a0f4b-3ef0-480a-b004-94d2630bc73d None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:01.348382 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1674bd-5216-4d2c-adf8-b6b8a72758c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:01.349027 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1674bd-5216-4d2c-adf8-b6b8a72758c8 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:01.349316 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1674bd-5216-4d2c-adf8-b6b8a72758c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:01.349680 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1674bd-5216-4d2c-adf8-b6b8a72758c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:01.361001 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1674bd-5216-4d2c-adf8-b6b8a72758c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:01.362447 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1674bd-5216-4d2c-adf8-b6b8a72758c8 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:01.372895 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 604/1203] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:09:01 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:09:01.915826 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b8e0b-3fa6-4d6a-b386-566549ff5663 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:01.916304 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b8e0b-3fa6-4d6a-b386-566549ff5663 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:01.916467 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b8e0b-3fa6-4d6a-b386-566549ff5663 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:01.918148 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 600/1204] 10.222.0.98 () {54 vars in 962 bytes} [Mon Jul 25 19:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:09:01.925747 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd30a1-7f9a-406b-8305-a4041d250254 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:01.926164 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd30a1-7f9a-406b-8305-a4041d250254 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:01.926550 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd30a1-7f9a-406b-8305-a4041d250254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:01.938487 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41913b44-a35b-4e60-a57d-7efe296ee376 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:01.938833 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41913b44-a35b-4e60-a57d-7efe296ee376 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:01.939226 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41913b44-a35b-4e60-a57d-7efe296ee376 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:01.942101 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 601/1205] 10.222.0.98 () {54 vars in 961 bytes} [Mon Jul 25 19:09:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 19:09:01.948648 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb5d44-238e-4ed4-92d2-cbdcbb8b8734 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:01.949079 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb5d44-238e-4ed4-92d2-cbdcbb8b8734 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:01.949514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb5d44-238e-4ed4-92d2-cbdcbb8b8734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:01.954068 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-b8cd30a1-7f9a-406b-8305-a4041d250254 None None] MFA Rules not processed for user `6aa237d6badd493a9f2a75bf4086fec3`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:01.955405 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-b8cd30a1-7f9a-406b-8305-a4041d250254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:01.967090 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 605/1206] 10.222.0.98 () {58 vars in 1059 bytes} [Mon Jul 25 19:09:01 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:09:01.974663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe28a-daa2-46e6-be34-c357c04960ef None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:01.974663 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe28a-daa2-46e6-be34-c357c04960ef None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:01.974988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe28a-daa2-46e6-be34-c357c04960ef None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:01.981118 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 606/1207] 10.222.0.98 () {54 vars in 912 bytes} [Mon Jul 25 19:09:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:09:01.983315 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-40cb5d44-238e-4ed4-92d2-cbdcbb8b8734 None None] MFA Rules not processed for user `679756d5f79e451bba682356d961883f`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:01.983815 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c90af-1bcb-45ce-a142-15488e3d1fc6 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:01.984211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c90af-1bcb-45ce-a142-15488e3d1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:01.984599 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c90af-1bcb-45ce-a142-15488e3d1fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:01.984788 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-40cb5d44-238e-4ed4-92d2-cbdcbb8b8734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:02.001478 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=100 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:02.013438 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:02.028308 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-ce4c90af-1bcb-45ce-a142-15488e3d1fc6 None None] MFA Rules not processed for user `6aa237d6badd493a9f2a75bf4086fec3`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:02.029869 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-ce4c90af-1bcb-45ce-a142-15488e3d1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:02.045953 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 607/1208] 10.222.0.98 () {58 vars in 1009 bytes} [Mon Jul 25 19:09:01 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:09:02.060806 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c90af-1bcb-45ce-a142-15488e3d1fc6 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:02.071569 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c90af-1bcb-45ce-a142-15488e3d1fc6 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:02.077804 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1690798-7959-4d76-b9c0-7880914771d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:02.078400 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1690798-7959-4d76-b9c0-7880914771d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:02.078732 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1690798-7959-4d76-b9c0-7880914771d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:02.079084 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1690798-7959-4d76-b9c0-7880914771d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:02.091717 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1690798-7959-4d76-b9c0-7880914771d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:02.093587 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1690798-7959-4d76-b9c0-7880914771d4 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:02.105949 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 602/1209] 10.222.0.98 () {58 vars in 1058 bytes} [Mon Jul 25 19:09:01 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:09:02.113235 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 608/1210] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:09:02 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:09:02.128203 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb5d44-238e-4ed4-92d2-cbdcbb8b8734 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:02.141866 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb5d44-238e-4ed4-92d2-cbdcbb8b8734 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:02.148678 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0769e-0894-4f1f-b318-6f1517978fc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679756d5f79e451bba682356d961883f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:02.149449 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0769e-0894-4f1f-b318-6f1517978fc9 service placement] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:02.149815 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0769e-0894-4f1f-b318-6f1517978fc9 service placement] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:02.150175 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0769e-0894-4f1f-b318-6f1517978fc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:02.153896 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-2ef0769e-0894-4f1f-b318-6f1517978fc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:02.209072 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0769e-0894-4f1f-b318-6f1517978fc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:02.212157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0769e-0894-4f1f-b318-6f1517978fc9 service placement] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:02.239485 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 603/1211] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:09:02 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:09:12.101069 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=6 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:12.223754 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=28 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:12.597367 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b56005-c9f7-4e65-ab38-d2be6a02ccb5 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:12.597689 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b56005-c9f7-4e65-ab38-d2be6a02ccb5 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:12.598044 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b56005-c9f7-4e65-ab38-d2be6a02ccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:12.626022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-69b56005-c9f7-4e65-ab38-d2be6a02ccb5 None None] MFA Rules not processed for user `b04784c6c0684d8082b954cd4caf32bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:12.627399 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-69b56005-c9f7-4e65-ab38-d2be6a02ccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:12.634260 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 609/1212] 10.222.0.100 () {58 vars in 1016 bytes} [Mon Jul 25 19:09:12 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:09:12.652561 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0769e-0894-4f1f-b318-6f1517978fc9 service placement] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:12.654985 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-2ef0769e-0894-4f1f-b318-6f1517978fc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:12.669595 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0769e-0894-4f1f-b318-6f1517978fc9 service placement] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:12.673512 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407572c-b499-480f-a582-ddbfa59bd701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:12.674193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407572c-b499-480f-a582-ddbfa59bd701 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:12.674480 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407572c-b499-480f-a582-ddbfa59bd701 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:12.674768 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407572c-b499-480f-a582-ddbfa59bd701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:12.690592 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407572c-b499-480f-a582-ddbfa59bd701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:12.692084 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407572c-b499-480f-a582-ddbfa59bd701 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:12.701402 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 604/1213] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:09:12 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:09:13.633177 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9c75-6e62-4722-8e88-35c20693502c None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:13.633785 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9c75-6e62-4722-8e88-35c20693502c None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:13.633904 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9c75-6e62-4722-8e88-35c20693502c None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:13.635777 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 610/1214] 10.222.0.98 () {54 vars in 921 bytes} [Mon Jul 25 19:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:09:13.643232 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b45cdd-c011-4fac-aa40-2fda492dec01 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:13.644530 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b45cdd-c011-4fac-aa40-2fda492dec01 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:13.645082 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b45cdd-c011-4fac-aa40-2fda492dec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:13.673376 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-65b45cdd-c011-4fac-aa40-2fda492dec01 None None] MFA Rules not processed for user `6aa237d6badd493a9f2a75bf4086fec3`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:13.678293 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-65b45cdd-c011-4fac-aa40-2fda492dec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:13.691202 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 605/1215] 10.222.0.98 () {58 vars in 1018 bytes} [Mon Jul 25 19:09:13 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:09:13.725960 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c9c75-6e62-4722-8e88-35c20693502c None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:13.744737 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c9c75-6e62-4722-8e88-35c20693502c None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:13.759612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b126e-bd63-42bc-9e09-02892357377d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:13.760365 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b126e-bd63-42bc-9e09-02892357377d service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:13.760774 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b126e-bd63-42bc-9e09-02892357377d service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:13.761076 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b126e-bd63-42bc-9e09-02892357377d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:13.779558 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b126e-bd63-42bc-9e09-02892357377d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:13.782157 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b126e-bd63-42bc-9e09-02892357377d service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:13.801060 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 611/1216] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:09:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:09:21.040112 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277eb46-f1a3-4924-abc5-2bc9920e783d None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:21.040728 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277eb46-f1a3-4924-abc5-2bc9920e783d None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:21.040962 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277eb46-f1a3-4924-abc5-2bc9920e783d None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:21.042322 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 606/1217] 10.222.0.98 () {54 vars in 921 bytes} [Mon Jul 25 19:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:09:21.051221 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ed01a-9016-4d8e-869c-0784a776401a None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:21.052210 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ed01a-9016-4d8e-869c-0784a776401a None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:21.052708 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ed01a-9016-4d8e-869c-0784a776401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:21.079931 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-c02ed01a-9016-4d8e-869c-0784a776401a None None] MFA Rules not processed for user `6aa237d6badd493a9f2a75bf4086fec3`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:21.081182 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-c02ed01a-9016-4d8e-869c-0784a776401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:21.091718 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 612/1218] 10.222.0.98 () {58 vars in 1018 bytes} [Mon Jul 25 19:09:21 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:09:21.114361 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277eb46-f1a3-4924-abc5-2bc9920e783d None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:21.129514 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277eb46-f1a3-4924-abc5-2bc9920e783d None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:21.136299 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da533c3-0970-465c-8106-1ec96331ecc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:21.136968 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da533c3-0970-465c-8106-1ec96331ecc1 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:21.137308 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da533c3-0970-465c-8106-1ec96331ecc1 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:21.137593 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da533c3-0970-465c-8106-1ec96331ecc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:21.147566 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da533c3-0970-465c-8106-1ec96331ecc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:21.149193 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da533c3-0970-465c-8106-1ec96331ecc1 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:21.161099 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 607/1219] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:09:21 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:09:31.075044 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=12 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:31.156690 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=15 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:33.283436 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ed01a-9016-4d8e-869c-0784a776401a None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:33.294944 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ed01a-9016-4d8e-869c-0784a776401a None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:33.300272 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998171e-2491-4c5a-852e-b3fb2ed0b601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:33.301119 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998171e-2491-4c5a-852e-b3fb2ed0b601 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:33.301644 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998171e-2491-4c5a-852e-b3fb2ed0b601 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:33.301998 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998171e-2491-4c5a-852e-b3fb2ed0b601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:33.312298 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998171e-2491-4c5a-852e-b3fb2ed0b601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:33.313832 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998171e-2491-4c5a-852e-b3fb2ed0b601 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:33.323589 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 613/1220] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:09:33 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:09:35.756401 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786b97-5525-42f3-8238-baf435a1c504 None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:35.757275 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786b97-5525-42f3-8238-baf435a1c504 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:35.757275 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786b97-5525-42f3-8238-baf435a1c504 None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:35.759226 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 608/1221] 10.222.0.98 () {54 vars in 921 bytes} [Mon Jul 25 19:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:09:35.766843 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9f178-8da8-41de-b607-3cc73be4eaf2 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:35.767508 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9f178-8da8-41de-b607-3cc73be4eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:35.767749 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9f178-8da8-41de-b607-3cc73be4eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:35.801756 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-10c9f178-8da8-41de-b607-3cc73be4eaf2 None None] MFA Rules not processed for user `6aa237d6badd493a9f2a75bf4086fec3`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:35.803987 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-10c9f178-8da8-41de-b607-3cc73be4eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:35.818551 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 614/1222] 10.222.0.98 () {58 vars in 1018 bytes} [Mon Jul 25 19:09:35 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:09:35.836023 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b786b97-5525-42f3-8238-baf435a1c504 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:35.860227 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b786b97-5525-42f3-8238-baf435a1c504 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:35.876596 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5face365-54d2-4835-b234-c5f7b8c04a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:35.879039 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5face365-54d2-4835-b234-c5f7b8c04a9f service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:35.879463 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5face365-54d2-4835-b234-c5f7b8c04a9f service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:35.879749 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5face365-54d2-4835-b234-c5f7b8c04a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:35.901137 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5face365-54d2-4835-b234-c5f7b8c04a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:35.903923 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5face365-54d2-4835-b234-c5f7b8c04a9f service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:35.927329 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 609/1223] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:09:35 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:09:45.790634 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=9 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:45.912900 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=6 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:58.017508 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4c94-5aad-41d9-8664-4ed80b0ff7a1 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:58.018206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4c94-5aad-41d9-8664-4ed80b0ff7a1 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:58.018206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4c94-5aad-41d9-8664-4ed80b0ff7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:58.037895 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-bbdb4c94-5aad-41d9-8664-4ed80b0ff7a1 None None] MFA Rules not processed for user `16dfb749c2af4b67964f1a19038eee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:58.039110 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-bbdb4c94-5aad-41d9-8664-4ed80b0ff7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:58.046864 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 615/1224] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:09:58 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:08.033166 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:24.600609 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d704-db0a-4c72-9c39-f46bc417b31b None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:24.601136 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d704-db0a-4c72-9c39-f46bc417b31b None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:24.601136 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d704-db0a-4c72-9c39-f46bc417b31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:24.621745 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-9353d704-db0a-4c72-9c39-f46bc417b31b None None] MFA Rules not processed for user `16dfb749c2af4b67964f1a19038eee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:24.622949 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-9353d704-db0a-4c72-9c39-f46bc417b31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:24.629851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 610/1225] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:10:24 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:34.616002 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=3 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:39.313427 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1240fa-243b-4a8e-a047-8069e7ed14a2 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:39.313949 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1240fa-243b-4a8e-a047-8069e7ed14a2 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:39.314246 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1240fa-243b-4a8e-a047-8069e7ed14a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:39.334482 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-cd1240fa-243b-4a8e-a047-8069e7ed14a2 None None] MFA Rules not processed for user `16dfb749c2af4b67964f1a19038eee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:39.335730 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-cd1240fa-243b-4a8e-a047-8069e7ed14a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:39.343539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 616/1226] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:10:39 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:49.329713 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:40.933855 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8acea-6168-40d7-b749-19b346aae121 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:40.934437 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8acea-6168-40d7-b749-19b346aae121 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:40.934437 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8acea-6168-40d7-b749-19b346aae121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:40.954012 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-9fb8acea-6168-40d7-b749-19b346aae121 None None] MFA Rules not processed for user `16dfb749c2af4b67964f1a19038eee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:40.955196 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-9fb8acea-6168-40d7-b749-19b346aae121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:40.963223 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 611/1227] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:11:40 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:50.948611 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=3 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:55.096383 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1240fa-243b-4a8e-a047-8069e7ed14a2 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:55.118154 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1240fa-243b-4a8e-a047-8069e7ed14a2 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:55.122349 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b0267-76bd-4f48-8f42-67a48e9f8496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:55.122993 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0267-76bd-4f48-8f42-67a48e9f8496 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:55.123305 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0267-76bd-4f48-8f42-67a48e9f8496 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:55.123578 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0267-76bd-4f48-8f42-67a48e9f8496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:55.133708 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b0267-76bd-4f48-8f42-67a48e9f8496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:55.135183 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b0267-76bd-4f48-8f42-67a48e9f8496 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:55.144679 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 617/1228] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:11:55 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:05.140457 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=10 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:52.094144 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8acea-6168-40d7-b749-19b346aae121 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:52.118357 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8acea-6168-40d7-b749-19b346aae121 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:52.123528 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5c86a-ba7b-472e-b4ff-c86f3d1612ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679756d5f79e451bba682356d961883f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:52.124239 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5c86a-ba7b-472e-b4ff-c86f3d1612ee service placement] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:52.124519 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5c86a-ba7b-472e-b4ff-c86f3d1612ee service placement] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:52.124796 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5c86a-ba7b-472e-b4ff-c86f3d1612ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:52.134525 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5c86a-ba7b-472e-b4ff-c86f3d1612ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:52.136152 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5c86a-ba7b-472e-b4ff-c86f3d1612ee service placement] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:52.146261 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 612/1229] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:12:52 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:02.141707 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=10 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:33.923785 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4003-5f3d-4c9b-bd03-6e135574eb76 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:33.924350 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4003-5f3d-4c9b-bd03-6e135574eb76 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:33.924350 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4003-5f3d-4c9b-bd03-6e135574eb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:33.945788 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-30ee4003-5f3d-4c9b-bd03-6e135574eb76 None None] MFA Rules not processed for user `7104acbe372c477b853d928c3965bdea`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:33.946926 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-30ee4003-5f3d-4c9b-bd03-6e135574eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:33.953746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 618/1230] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:13:33 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:13:43.940211 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:51.296156 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5c86a-ba7b-472e-b4ff-c86f3d1612ee service placement] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:51.305587 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5c86a-ba7b-472e-b4ff-c86f3d1612ee service placement] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:51.309256 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b5c8c-de65-441a-89e2-9691ad63e835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:51.309893 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b5c8c-de65-441a-89e2-9691ad63e835 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:51.310178 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b5c8c-de65-441a-89e2-9691ad63e835 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:51.310456 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b5c8c-de65-441a-89e2-9691ad63e835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:51.320000 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b5c8c-de65-441a-89e2-9691ad63e835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:51.321453 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b5c8c-de65-441a-89e2-9691ad63e835 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:51.331240 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 613/1231] 10.222.0.98 () {60 vars in 1396 bytes} [Mon Jul 25 19:13:51 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2812 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:14:01.326357 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=6 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:01.938136 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee4003-5f3d-4c9b-bd03-6e135574eb76 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:01.948567 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee4003-5f3d-4c9b-bd03-6e135574eb76 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:01.952664 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888fd24-6ad8-4973-958a-f9dac7988216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:01.953322 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888fd24-6ad8-4973-958a-f9dac7988216 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:01.953608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888fd24-6ad8-4973-958a-f9dac7988216 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:01.953883 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888fd24-6ad8-4973-958a-f9dac7988216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:01.964762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888fd24-6ad8-4973-958a-f9dac7988216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:01.965986 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888fd24-6ad8-4973-958a-f9dac7988216 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:01.993900 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 619/1232] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:14:01 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:14:06.204015 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b5c8c-de65-441a-89e2-9691ad63e835 service neutron] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:06.216205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b5c8c-de65-441a-89e2-9691ad63e835 service neutron] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:06.221266 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b768f0-7a3a-4527-bf0b-473b746ba512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:06.221936 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b768f0-7a3a-4527-bf0b-473b746ba512 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:06.222222 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b768f0-7a3a-4527-bf0b-473b746ba512 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:06.222500 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b768f0-7a3a-4527-bf0b-473b746ba512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:06.230705 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b768f0-7a3a-4527-bf0b-473b746ba512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:06.232575 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b768f0-7a3a-4527-bf0b-473b746ba512 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:06.242570 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 614/1233] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:14:06 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:14:06.427820 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888fd24-6ad8-4973-958a-f9dac7988216 service neutron] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:06.436441 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888fd24-6ad8-4973-958a-f9dac7988216 service neutron] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:06.440569 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaaf76-3d22-4382-832d-b93e56dcb0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:06.441209 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaaf76-3d22-4382-832d-b93e56dcb0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:06.441501 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaaf76-3d22-4382-832d-b93e56dcb0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:06.441776 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaaf76-3d22-4382-832d-b93e56dcb0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:06.451255 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaaf76-3d22-4382-832d-b93e56dcb0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:06.452715 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaaf76-3d22-4382-832d-b93e56dcb0b1 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:06.463536 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 620/1234] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:14:06 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:14:09.952751 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81caf82-a5c5-4080-b347-52e5afd77c48 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:09.953240 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81caf82-a5c5-4080-b347-52e5afd77c48 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:09.953542 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81caf82-a5c5-4080-b347-52e5afd77c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:09.975672 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-f81caf82-a5c5-4080-b347-52e5afd77c48 None None] MFA Rules not processed for user `16dfb749c2af4b67964f1a19038eee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:14:09.976912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-f81caf82-a5c5-4080-b347-52e5afd77c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:09.984550 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 615/1235] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:14:09 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:14:10.323160 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaaf76-3d22-4382-832d-b93e56dcb0b1 service neutron] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:10.331737 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaaf76-3d22-4382-832d-b93e56dcb0b1 service neutron] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:10.335650 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02eea-4006-4013-a0da-66d5f61f82f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:10.336288 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02eea-4006-4013-a0da-66d5f61f82f1 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:10.336573 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02eea-4006-4013-a0da-66d5f61f82f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:10.336854 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02eea-4006-4013-a0da-66d5f61f82f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:10.343965 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca02eea-4006-4013-a0da-66d5f61f82f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:10.346133 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca02eea-4006-4013-a0da-66d5f61f82f1 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:10.353934 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 621/1236] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:14:10 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:14:10.805582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81caf82-a5c5-4080-b347-52e5afd77c48 None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:10.818582 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81caf82-a5c5-4080-b347-52e5afd77c48 None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:10.824919 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42fcfe-0b01-4c99-bbe3-689bbc30f8bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679756d5f79e451bba682356d961883f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:10.825574 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42fcfe-0b01-4c99-bbe3-689bbc30f8bd service placement] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:10.826205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42fcfe-0b01-4c99-bbe3-689bbc30f8bd service placement] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:10.826205 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42fcfe-0b01-4c99-bbe3-689bbc30f8bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:10.836885 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42fcfe-0b01-4c99-bbe3-689bbc30f8bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:10.838476 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42fcfe-0b01-4c99-bbe3-689bbc30f8bd service placement] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:10.849110 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 616/1237] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:14:10 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:14:12.497638 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02eea-4006-4013-a0da-66d5f61f82f1 service neutron] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:12.507694 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02eea-4006-4013-a0da-66d5f61f82f1 service neutron] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:12.511654 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a8f2a-fd7e-4042-b777-6e02a593b2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:12.512376 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a8f2a-fd7e-4042-b777-6e02a593b2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:12.512729 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a8f2a-fd7e-4042-b777-6e02a593b2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:12.513079 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a8f2a-fd7e-4042-b777-6e02a593b2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:12.522452 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a8f2a-fd7e-4042-b777-6e02a593b2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:12.523941 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a8f2a-fd7e-4042-b777-6e02a593b2a9 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:12.535339 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 622/1238] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:14:12 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:14:20.844405 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=15 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:22.529005 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=28 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:23.419931 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42fcfe-0b01-4c99-bbe3-689bbc30f8bd service placement] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:23.432250 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42fcfe-0b01-4c99-bbe3-689bbc30f8bd service placement] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:23.437364 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd586aa-82ac-435a-a17d-8a53b73adb3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:23.438091 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd586aa-82ac-435a-a17d-8a53b73adb3d service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:23.439289 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd586aa-82ac-435a-a17d-8a53b73adb3d service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:23.439428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd586aa-82ac-435a-a17d-8a53b73adb3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:23.449196 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd586aa-82ac-435a-a17d-8a53b73adb3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:23.450895 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd586aa-82ac-435a-a17d-8a53b73adb3d service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:23.462048 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 617/1239] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:14:23 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:14:33.457674 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=6 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:22.194448 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a8f2a-fd7e-4042-b777-6e02a593b2a9 service neutron] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:22.215910 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a8f2a-fd7e-4042-b777-6e02a593b2a9 service neutron] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:22.227863 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573464c-7c69-421d-8c30-ed20ee4b9e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:22.228907 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573464c-7c69-421d-8c30-ed20ee4b9e11 service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:22.229402 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573464c-7c69-421d-8c30-ed20ee4b9e11 service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:22.229859 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573464c-7c69-421d-8c30-ed20ee4b9e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:22.250790 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573464c-7c69-421d-8c30-ed20ee4b9e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:22.253013 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573464c-7c69-421d-8c30-ed20ee4b9e11 service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:22.276365 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 623/1240] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:15:22 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:15:30.551214 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd586aa-82ac-435a-a17d-8a53b73adb3d service nova] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:30.560215 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd586aa-82ac-435a-a17d-8a53b73adb3d service nova] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:30.563813 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3897c-9cd1-46c9-87bd-4ebcdfeef288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:30.564451 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3897c-9cd1-46c9-87bd-4ebcdfeef288 service neutron] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:30.564730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3897c-9cd1-46c9-87bd-4ebcdfeef288 service neutron] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:30.565006 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3897c-9cd1-46c9-87bd-4ebcdfeef288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:30.626400 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3897c-9cd1-46c9-87bd-4ebcdfeef288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:30.627902 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3897c-9cd1-46c9-87bd-4ebcdfeef288 service neutron] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:30.647157 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 618/1241] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:15:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:15:32.263988 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=6 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:34.388645 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9736d7-8d97-454a-8d7c-d248bb883900 None None] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:34.389978 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9736d7-8d97-454a-8d7c-d248bb883900 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:34.389978 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9736d7-8d97-454a-8d7c-d248bb883900 None None] PATH_INFO: `/` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:34.391393 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 624/1242] 10.222.0.98 () {54 vars in 921 bytes} [Mon Jul 25 19:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:15:34.406732 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed953126-6deb-43b3-80e5-a878d9511f39 None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:34.407358 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed953126-6deb-43b3-80e5-a878d9511f39 None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:34.407358 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed953126-6deb-43b3-80e5-a878d9511f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:34.522305 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-ed953126-6deb-43b3-80e5-a878d9511f39 None None] MFA Rules not processed for user `679756d5f79e451bba682356d961883f`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:15:34.523892 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-ed953126-6deb-43b3-80e5-a878d9511f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:34.533211 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 619/1243] 10.222.0.98 () {58 vars in 1018 bytes} [Mon Jul 25 19:15:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:15:34.544055 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9736d7-8d97-454a-8d7c-d248bb883900 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:34.558354 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9736d7-8d97-454a-8d7c-d248bb883900 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:34.567039 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09443015-816b-427a-a8fa-d500c8a35c1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679756d5f79e451bba682356d961883f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:34.568079 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09443015-816b-427a-a8fa-d500c8a35c1b service placement] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:34.568397 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09443015-816b-427a-a8fa-d500c8a35c1b service placement] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:34.568762 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09443015-816b-427a-a8fa-d500c8a35c1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:34.579160 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09443015-816b-427a-a8fa-d500c8a35c1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:34.580854 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09443015-816b-427a-a8fa-d500c8a35c1b service placement] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:34.591894 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 625/1244] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:15:34 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:15:38.289330 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff93feb-ebee-42f2-8a05-a1febf034d8e None None] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:38.290191 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff93feb-ebee-42f2-8a05-a1febf034d8e None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:38.290191 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff93feb-ebee-42f2-8a05-a1febf034d8e None None] PATH_INFO: `/` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:38.291878 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 620/1245] 10.222.0.98 () {54 vars in 921 bytes} [Mon Jul 25 19:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 19:15:38.323971 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5506a8-00ad-4b34-814b-6b32e3fa3df3 None None] REQUEST_METHOD: `POST` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:38.324539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5506a8-00ad-4b34-814b-6b32e3fa3df3 None None] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:38.324539 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5506a8-00ad-4b34-814b-6b32e3fa3df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:38.362621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.auth.core [None req-3b5506a8-00ad-4b34-814b-6b32e3fa3df3 None None] MFA Rules not processed for user `679756d5f79e451bba682356d961883f`. Rule list: `[]` (Enabled: `True`). {{(pid=87412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:15:38.364147 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-3b5506a8-00ad-4b34-814b-6b32e3fa3df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:38.379612 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff93feb-ebee-42f2-8a05-a1febf034d8e None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:38.383215 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 626/1246] 10.222.0.98 () {58 vars in 1018 bytes} [Mon Jul 25 19:15:38 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:15:38.400161 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5506a8-00ad-4b34-814b-6b32e3fa3df3 None None] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:38.403104 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff93feb-ebee-42f2-8a05-a1febf034d8e None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:38.408868 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:38.410080 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:38.410392 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:38.410729 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] PATH_INFO: `/v3/users/7104acbe372c477b853d928c3965bdea` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:38.412287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7104acbe372c477b853d928c3965bdea)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:38.413319 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5506a8-00ad-4b34-814b-6b32e3fa3df3 None None] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:38.414386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:38.418919 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3ef74-4d46-46e7-b0ff-e60c96a0b831 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679756d5f79e451bba682356d961883f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:38.419610 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ef74-4d46-46e7-b0ff-e60c96a0b831 service placement] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:38.420414 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ef74-4d46-46e7-b0ff-e60c96a0b831 service placement] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:38.420708 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ef74-4d46-46e7-b0ff-e60c96a0b831 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:38.429784 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3ef74-4d46-46e7-b0ff-e60c96a0b831 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:38.431480 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3ef74-4d46-46e7-b0ff-e60c96a0b831 service placement] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:38.443949 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 627/1247] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:15:38 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:15:38.474507 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7104acbe372c477b853d928c3965bdea'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:38.484689 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7104acbe372c477b853d928c3965bdea'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:38.492028 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7104acbe372c477b853d928c3965bdea'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:38.505388 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7104acbe372c477b853d928c3965bdea'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:38.506171 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7104acbe372c477b853d928c3965bdea'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:38.512646 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 621/1248] 10.222.0.98 () {58 vars in 1224 bytes} [Mon Jul 25 19:15:38 2022] DELETE /identity/v3/users/7104acbe372c477b853d928c3965bdea => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:15:38.711586 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3ef74-4d46-46e7-b0ff-e60c96a0b831 service placement] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:38.723282 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3ef74-4d46-46e7-b0ff-e60c96a0b831 service placement] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:38.783752 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:38.784632 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:38.784921 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:38.785206 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] PATH_INFO: `/v3/projects/f3e531ef7faa48ab9f512516351a7eb4` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:38.786416 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e531ef7faa48ab9f512516351a7eb4)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:38.788405 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:38.836296 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e531ef7faa48ab9f512516351a7eb4', 'request_id': 'req-92cee95b-aab8-4c2d-9335-257ce5c62c7c'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:38.842947 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e531ef7faa48ab9f512516351a7eb4', 'request_id': 'req-92cee95b-aab8-4c2d-9335-257ce5c62c7c'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:38.850885 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e531ef7faa48ab9f512516351a7eb4', 'request_id': 'req-92cee95b-aab8-4c2d-9335-257ce5c62c7c'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:38.862621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] The token cache is being invalidate because project f3e531ef7faa48ab9f512516351a7eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:15:38.862987 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:38.863651 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:38.865376 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 628/1249] 10.222.0.98 () {58 vars in 1233 bytes} [Mon Jul 25 19:15:38 2022] DELETE /identity/v3/projects/f3e531ef7faa48ab9f512516351a7eb4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:15:38.869615 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:38.871119 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:38.884752 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09bef3-8397-40d7-bfbd-c42277b92bbd admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:38.897206 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:38.945730 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:38.946616 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:38.946904 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:38.947216 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] PATH_INFO: `/v3/users/8ee9f7487594444eb7ea3372f3c4dd84` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:38.948428 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee9f7487594444eb7ea3372f3c4dd84)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:38.950415 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:39.002247 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee9f7487594444eb7ea3372f3c4dd84'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:39.010781 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee9f7487594444eb7ea3372f3c4dd84'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:39.020124 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee9f7487594444eb7ea3372f3c4dd84'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:39.033027 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee9f7487594444eb7ea3372f3c4dd84'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:39.033768 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-52fbe34b-df23-4d08-acb6-66495c9f87c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee9f7487594444eb7ea3372f3c4dd84'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:39.039776 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 622/1250] 10.222.0.98 () {58 vars in 1224 bytes} [Mon Jul 25 19:15:38 2022] DELETE /identity/v3/users/8ee9f7487594444eb7ea3372f3c4dd84 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:15:39.232278 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:39.234428 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:39.250571 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cee95b-aab8-4c2d-9335-257ce5c62c7c admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:39.305174 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:39.313277 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:39.314556 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:39.315041 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:39.315595 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] PATH_INFO: `/v3/projects/7df985c4fc8d40e19f6b7d2bfb7a4c2f` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:39.317161 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7df985c4fc8d40e19f6b7d2bfb7a4c2f)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:39.319621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:39.374263 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df985c4fc8d40e19f6b7d2bfb7a4c2f', 'request_id': 'req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:39.381233 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df985c4fc8d40e19f6b7d2bfb7a4c2f', 'request_id': 'req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:39.391465 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df985c4fc8d40e19f6b7d2bfb7a4c2f', 'request_id': 'req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:39.402608 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] The token cache is being invalidate because project 7df985c4fc8d40e19f6b7d2bfb7a4c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:15:39.402895 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:39.403612 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:39.405672 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 629/1251] 10.222.0.98 () {58 vars in 1233 bytes} [Mon Jul 25 19:15:39 2022] DELETE /identity/v3/projects/7df985c4fc8d40e19f6b7d2bfb7a4c2f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:15:49.040464 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:49.399741 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:18.320160 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10de29c-a3d7-4da3-a7b2-99f8370473ec None None] REQUEST_METHOD: `POST` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:18.320733 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10de29c-a3d7-4da3-a7b2-99f8370473ec None None] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:18.320733 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10de29c-a3d7-4da3-a7b2-99f8370473ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:18.342843 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.auth.core [None req-b10de29c-a3d7-4da3-a7b2-99f8370473ec None None] MFA Rules not processed for user `16dfb749c2af4b67964f1a19038eee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:16:18.344333 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-b10de29c-a3d7-4da3-a7b2-99f8370473ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:18.410331 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 623/1252] 10.222.0.98 () {58 vars in 958 bytes} [Mon Jul 25 19:16:18 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:16:28.404007 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=25 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:31.256357 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:16:31.257809 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:31.357308 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b7fc9-1d9b-4cde-b6da-02ae0b929fbd admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:16:31.362521 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb1b2d-7147-47a0-ba34-2a12f2a77538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:16:31.363225 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb1b2d-7147-47a0-ba34-2a12f2a77538 service nova] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:31.363515 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb1b2d-7147-47a0-ba34-2a12f2a77538 service nova] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:31.363796 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb1b2d-7147-47a0-ba34-2a12f2a77538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:31.365631 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-bceb1b2d-7147-47a0-ba34-2a12f2a77538 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:31.378335 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb1b2d-7147-47a0-ba34-2a12f2a77538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:16:31.380022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb1b2d-7147-47a0-ba34-2a12f2a77538 service nova] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:16:31.392297 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 630/1253] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:16:31 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:41.386392 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=32 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:58.064694 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10de29c-a3d7-4da3-a7b2-99f8370473ec None None] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:58.066086 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-b10de29c-a3d7-4da3-a7b2-99f8370473ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:58.209912 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10de29c-a3d7-4da3-a7b2-99f8370473ec None None] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:58.218562 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceb1aa-c70c-4cd4-84ab-a87ad6f032ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679756d5f79e451bba682356d961883f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:58.219258 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceb1aa-c70c-4cd4-84ab-a87ad6f032ea service placement] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:58.219548 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceb1aa-c70c-4cd4-84ab-a87ad6f032ea service placement] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:58.219839 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceb1aa-c70c-4cd4-84ab-a87ad6f032ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:58.221736 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-59ceb1aa-c70c-4cd4-84ab-a87ad6f032ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:58.235668 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ceb1aa-c70c-4cd4-84ab-a87ad6f032ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:58.237300 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ceb1aa-c70c-4cd4-84ab-a87ad6f032ea service placement] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:58.248343 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 624/1254] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:17:58 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:18:08.243539 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=54 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:02.740381 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb1b2d-7147-47a0-ba34-2a12f2a77538 service nova] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:02.741820 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-bceb1b2d-7147-47a0-ba34-2a12f2a77538 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:02.841979 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb1b2d-7147-47a0-ba34-2a12f2a77538 service nova] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:02.846102 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677d2c7-30ae-4803-b86b-63524ea980d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:02.846760 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677d2c7-30ae-4803-b86b-63524ea980d8 service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:02.847048 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677d2c7-30ae-4803-b86b-63524ea980d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:02.847363 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677d2c7-30ae-4803-b86b-63524ea980d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:02.849695 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-d677d2c7-30ae-4803-b86b-63524ea980d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:03.003997 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677d2c7-30ae-4803-b86b-63524ea980d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:03.005477 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677d2c7-30ae-4803-b86b-63524ea980d8 service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:03.017007 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 631/1255] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:19:02 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:05.548217 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceb1aa-c70c-4cd4-84ab-a87ad6f032ea service placement] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:05.560667 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceb1aa-c70c-4cd4-84ab-a87ad6f032ea service placement] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:05.565508 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bb651-7f55-47bd-9ef8-146fac396147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa237d6badd493a9f2a75bf4086fec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:05.566149 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb651-7f55-47bd-9ef8-146fac396147 service nova] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:05.566430 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb651-7f55-47bd-9ef8-146fac396147 service nova] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:05.566704 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb651-7f55-47bd-9ef8-146fac396147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:05.568498 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-f35bb651-7f55-47bd-9ef8-146fac396147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:05.604371 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bb651-7f55-47bd-9ef8-146fac396147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:05.605989 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bb651-7f55-47bd-9ef8-146fac396147 service nova] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:05.624891 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 625/1256] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:19:05 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:07.582529 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677d2c7-30ae-4803-b86b-63524ea980d8 service neutron] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:07.591867 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677d2c7-30ae-4803-b86b-63524ea980d8 service neutron] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:07.595592 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9504ab-a552-4f39-8aee-0c824b1c0d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b04784c6c0684d8082b954cd4caf32bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:07.596336 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9504ab-a552-4f39-8aee-0c824b1c0d4e service neutron] REQUEST_METHOD: `GET` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:07.596690 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9504ab-a552-4f39-8aee-0c824b1c0d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:07.596964 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9504ab-a552-4f39-8aee-0c824b1c0d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:07.599022 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-5d9504ab-a552-4f39-8aee-0c824b1c0d4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:07.689506 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9504ab-a552-4f39-8aee-0c824b1c0d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:07.690893 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9504ab-a552-4f39-8aee-0c824b1c0d4e service neutron] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:07.701617 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 632/1257] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:19:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:13.998510 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bb651-7f55-47bd-9ef8-146fac396147 service nova] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:14.000111 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-f35bb651-7f55-47bd-9ef8-146fac396147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:14.016516 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bb651-7f55-47bd-9ef8-146fac396147 service nova] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:14.020971 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:14.021838 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:14.022115 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:14.022386 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] PATH_INFO: `/v3/users/16dfb749c2af4b67964f1a19038eee5e` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.023591 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16dfb749c2af4b67964f1a19038eee5e)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:14.026204 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:14.073177 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16dfb749c2af4b67964f1a19038eee5e'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.079852 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16dfb749c2af4b67964f1a19038eee5e'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.087070 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16dfb749c2af4b67964f1a19038eee5e'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.099038 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16dfb749c2af4b67964f1a19038eee5e'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.099802 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16dfb749c2af4b67964f1a19038eee5e'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.106593 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 626/1258] 10.222.0.98 () {58 vars in 1224 bytes} [Mon Jul 25 19:19:13 2022] DELETE /identity/v3/users/16dfb749c2af4b67964f1a19038eee5e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:14.288029 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9504ab-a552-4f39-8aee-0c824b1c0d4e service neutron] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:14.299092 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9504ab-a552-4f39-8aee-0c824b1c0d4e service neutron] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:14.328746 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=100 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:14.368428 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:14.369748 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:14.370241 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:14.370710 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] PATH_INFO: `/v3/projects/f970202f866640ef959780976de9f3f8` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.373080 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f970202f866640ef959780976de9f3f8)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:14.376510 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:14.435325 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f970202f866640ef959780976de9f3f8', 'request_id': 'req-98f63840-23d2-48ad-a678-8c3ef1abf3bd'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.443352 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f970202f866640ef959780976de9f3f8', 'request_id': 'req-98f63840-23d2-48ad-a678-8c3ef1abf3bd'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.453047 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f970202f866640ef959780976de9f3f8', 'request_id': 'req-98f63840-23d2-48ad-a678-8c3ef1abf3bd'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.467819 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] The token cache is being invalidate because project f970202f866640ef959780976de9f3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:14.468113 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.468891 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.471157 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 633/1259] 10.222.0.98 () {58 vars in 1233 bytes} [Mon Jul 25 19:19:14 2022] DELETE /identity/v3/projects/f970202f866640ef959780976de9f3f8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:14.475004 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:14.477837 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:14.491433 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49851f94-1e8d-4c27-8d17-d31ec5491062 admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:14.558549 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:14.559994 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:14.560248 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:14.560798 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] PATH_INFO: `/v3/users/3f8e4fdffeb5425e9fc88acbf543b773` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.577155 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8e4fdffeb5425e9fc88acbf543b773)` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:14.579173 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:14.600921 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:14.627601 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8e4fdffeb5425e9fc88acbf543b773'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.637477 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8e4fdffeb5425e9fc88acbf543b773'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.645089 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8e4fdffeb5425e9fc88acbf543b773'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.657909 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8e4fdffeb5425e9fc88acbf543b773'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.658802 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.notifications [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8e4fdffeb5425e9fc88acbf543b773'} {{(pid=87413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.665032 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 627/1260] 10.222.0.98 () {58 vars in 1224 bytes} [Mon Jul 25 19:19:14 2022] DELETE /identity/v3/users/3f8e4fdffeb5425e9fc88acbf543b773 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:14.846788 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] Authenticating user token {{(pid=87412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:14.848237 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.fernet_utils [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:14.862169 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f63840-23d2-48ad-a678-8c3ef1abf3bd admin admin] Validating token access rules against request {{(pid=87412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:14.921517 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a14840580b5465f8931c6040356529d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32aa335f68034a49832bdfc49717db33', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:14.922420 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:14.922703 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:14.922981 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] PATH_INFO: `/v3/projects/55066eb5e299418da7a8d550a314f8d8` {{(pid=87412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.934073 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=55066eb5e299418da7a8d550a314f8d8)` {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:14.936054 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] RBAC: Authorization granted {{(pid=87412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:14.985238 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55066eb5e299418da7a8d550a314f8d8', 'request_id': 'req-fa0961b7-308a-45b4-81f5-30a61486a4cb'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:14.986241 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:14.993213 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55066eb5e299418da7a8d550a314f8d8', 'request_id': 'req-fa0961b7-308a-45b4-81f5-30a61486a4cb'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:15.002224 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55066eb5e299418da7a8d550a314f8d8', 'request_id': 'req-fa0961b7-308a-45b4-81f5-30a61486a4cb'} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:15.013621 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] The token cache is being invalidate because project 55066eb5e299418da7a8d550a314f8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:15.013954 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:15.014719 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG keystone.notifications [None req-fa0961b7-308a-45b4-81f5-30a61486a4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:15.016463 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: [pid: 87412|app: 0|req: 634/1261] 10.222.0.98 () {58 vars in 1233 bytes} [Mon Jul 25 19:19:14 2022] DELETE /identity/v3/projects/55066eb5e299418da7a8d550a314f8d8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:24.661685 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:25.010077 dv-osbrick-850937-1-ceph devstack@keystone.service[87412]: DEBUG dbcounter [-] [87412] Writing DB stats keystone:SELECT=6,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:23:02.023589 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] Authenticating user token {{(pid=87413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:23:02.025423 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:23:02.184925 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143c86a-8f98-4c06-8860-32b16ef20dc5 admin admin] Validating token access rules against request {{(pid=87413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:23:02.245287 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96cbae-8599-4995-bad3-48b04fcfd64a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679756d5f79e451bba682356d961883f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55faf272643648349c655751011854b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:23:02.245857 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96cbae-8599-4995-bad3-48b04fcfd64a service placement] REQUEST_METHOD: `GET` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:23:02.246141 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96cbae-8599-4995-bad3-48b04fcfd64a service placement] SCRIPT_NAME: `/identity` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:23:02.246411 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96cbae-8599-4995-bad3-48b04fcfd64a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:23:02.248317 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.fernet_utils [None req-6a96cbae-8599-4995-bad3-48b04fcfd64a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:23:02.259632 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96cbae-8599-4995-bad3-48b04fcfd64a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:23:02.261225 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96cbae-8599-4995-bad3-48b04fcfd64a service placement] RBAC: Authorization granted {{(pid=87413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:23:02.271052 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: [pid: 87413|app: 0|req: 628/1262] 10.222.0.98 () {60 vars in 1365 bytes} [Mon Jul 25 19:23:02 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:23:12.266851 dv-osbrick-850937-1-ceph devstack@keystone.service[87413]: DEBUG dbcounter [-] [87413] Writing DB stats keystone:SELECT=62 {{(pid=87413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}